-- Logs begin at Tue 2022-04-12 13:27:02 UTC, end at Tue 2022-04-12 14:49:37 UTC. -- Apr 12 14:04:41.338799 dv-cinder-837522-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 12 14:04:41.348832 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 12 14:04:41.350891 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 12 14:04:41 2022] *** Apr 12 14:04:41.350891 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 12 14:04:41.350891 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 12 14:04:41.350891 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: nodename: dv-cinder-837522-1-iscsi Apr 12 14:04:41.350891 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: machine: x86_64 Apr 12 14:04:41.350891 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: clock source: unix Apr 12 14:04:41.350891 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: pcre jit disabled Apr 12 14:04:41.350891 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: detected number of CPU cores: 4 Apr 12 14:04:41.350891 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: current working directory: / Apr 12 14:04:41.350891 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: detected binary path: /usr/bin/uwsgi-core Apr 12 14:04:41.350891 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: your processes number limit is 47680 Apr 12 14:04:41.351508 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: your memory page size is 4096 bytes Apr 12 14:04:41.351508 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: detected max file descriptor number: 2048 Apr 12 14:04:41.351508 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: lock engine: pthread robust mutexes Apr 12 14:04:41.351508 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: thunder lock: enabled Apr 12 14:04:41.351508 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 12 14:04:41.351508 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 12 14:04:41.396825 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: Python main interpreter initialized at 0x5584015e69c0 Apr 12 14:04:41.396825 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: python threads support enabled Apr 12 14:04:41.396825 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: your server socket listen backlog is limited to 100 connections Apr 12 14:04:41.396825 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: your mercy for graceful operations on workers is 90 seconds Apr 12 14:04:41.397198 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: mapped 403077 bytes (393 KB) for 2 cores Apr 12 14:04:41.397274 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: *** Operational MODE: preforking *** Apr 12 14:04:41.397533 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: *** uWSGI is running in multiple interpreter mode *** Apr 12 14:04:41.397533 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: spawned uWSGI master process (pid: 80163) Apr 12 14:04:41.397729 dv-cinder-837522-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 12 14:04:41.398883 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: spawned uWSGI worker 1 (pid: 80175, cores: 1) Apr 12 14:04:41.398883 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: spawned uWSGI worker 2 (pid: 80176, cores: 1) Apr 12 14:04:41.398883 dv-cinder-837522-1-iscsi devstack@keystone.service[80163]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 14:04:47.237599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:04:47.237599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: from cryptography.utils import int_from_bytes Apr 12 14:04:47.238372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:04:47.238372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: from cryptography.utils import int_from_bytes Apr 12 14:04:47.238787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:04:47.238787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: from cryptography.utils import int_from_bytes Apr 12 14:04:47.238895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:04:47.238895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: from cryptography.utils import int_from_bytes Apr 12 14:04:47.289081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 14:04:47.289272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 14:04:47.289359 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 14:04:47.289455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] command line args: [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 14:04:47.289529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 14:04:47.289676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] command line args: [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 14:04:47.289761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 14:04:47.289885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ================================================================================ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 14:04:47.289963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 14:04:47.290120 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ================================================================================ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 14:04:47.290206 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] admin_token = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.290380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] admin_token = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.290463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] config_dir = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.290568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.290645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config_dir = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.291265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] config_source = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.291384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.291514 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] debug = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.291647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config_source = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.291799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.292064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] debug = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.292064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.292293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.292293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.292475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.292475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.292676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.292778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.292873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.293015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.293128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.293128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_config_append = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.293311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.293407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.293507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_config_append = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.293607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_dir = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.293708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.293809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.293920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_dir = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.293920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.294110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.294190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.294310 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.294389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.294511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.294585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.294699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.294699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.294929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.295015 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.295140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.295140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.295320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.295434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.295513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.295693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.295770 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.295770 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.295948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.296069 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.296144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.296265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.296346 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.296429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.296501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.296622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.296700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.296873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.296952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.297183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.297403 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.297592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] publish_errors = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.297669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.297828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.297910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] publish_errors = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.298064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.298140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.298257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.298367 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.298483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.298594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.298726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.298917 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.299032 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.299149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] standard_threads = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.299149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.299370 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] standard_threads = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.299370 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.299592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.299592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.299801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.299919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] use_journal = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.300032 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.300148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] use_json = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.300260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_journal = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.300372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] use_stderr = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.300482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_json = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.300604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] use_syslog = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.300717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_stderr = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.300834 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.300952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_syslog = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.300952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:04:47.301197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.301197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.301419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.301419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.301632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.301632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.301854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.301974 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.302088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.302205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.302317 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.302435 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.302546 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.302665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.302784 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.302896 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.303007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.303117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.303233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.303352 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.303465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.303576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.303687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.303797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.303907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.304094 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.304216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.304334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.304452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.304576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.304695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.304815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.304929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.305068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.305191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.305310 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.305434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.305547 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.305659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.305769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.305879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.305996 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.306116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.306228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.306353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.307111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.307302 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.307491 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.307682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.307682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.307918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.308038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.308151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.308262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.308382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.308495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.308613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.308731 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.308843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.309005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.309134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.309249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.309367 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.309479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.309580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.309675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.309777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.309878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.309973 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.310066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.310159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.310250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.310352 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.310481 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.310595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.310708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.310821 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.310932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.311052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.311172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.311285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.311396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.311507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.311618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.311730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.311843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.311955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.312056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.312172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.312286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.312397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.312510 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.312630 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.312734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.312845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.312972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.313080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.313207 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.313321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.313433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.313544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.313655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.313756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.313874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.313988 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.314089 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.314199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.314310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.314421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.314530 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.314642 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.314753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.314864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.314976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.315088 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.315213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.315327 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.315439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.315550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.315661 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.315772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.315891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.316005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.316117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.316229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.316352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.316539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.316667 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.316781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.316781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.317015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.317015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.317228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.317228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.317451 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.317451 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.317667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.317780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.317892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.318014 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.318128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.318241 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.318359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.318359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.318581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.318702 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.318816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.318928 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.319039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.319156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.319270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.319393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.319519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.319638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.319751 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.319863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.319975 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.320076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.320194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.320315 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.320428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.320540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.320657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.320770 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.320891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.321018 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.321132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.321244 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.321357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.321468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.321595 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.321710 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.321828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.321941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.322078 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.322246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.322445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.322644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.322825 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.322953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.323068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.323180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.323304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.323420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.323533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.323645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.323756 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.324126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.324251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.324379 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.324501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.324620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.324739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.324858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.325021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.325138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.325251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.325373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.325487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.325600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.325720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.325834 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.325947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.326059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.326170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.326282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.326282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.external = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.326503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.326616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.326734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.326734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.external = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.326945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.327067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.327214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.327214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.password = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.327443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.327557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.token = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.327670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.327783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.327895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.password = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.328015 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.328130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.token = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.328243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.328361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.328479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.328591 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.328713 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.328829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.328948 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.329079 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.329191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.329304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.329429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.329550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.329664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.329777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.329896 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.330010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.330194 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.330310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.330423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.330535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.330647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.330760 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.330888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.331003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.331115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.331234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.331347 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.331469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.331591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.331712 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.331828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.331941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.332053 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.332166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.332287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.332401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.332514 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.332627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.332739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.332861 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.333031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.333148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.333261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.333373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.333485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.333613 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.333729 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.333841 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.333955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.334067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.334179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.334299 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.334413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.334574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.334696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.334809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.334921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.335043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.335158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.335271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.335384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.335497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.335611 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.335732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.335847 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.335960 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.336074 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.336186 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.336298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.336419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.336533 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.336646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.336758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.336871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.337001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.337129 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.337251 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.337365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.337478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.337604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.337722 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.337907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.338098 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.338289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.338433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.338548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.338645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.338767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.338883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.338996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.339109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.339229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.339344 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.339465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.339579 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.339692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.339804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.339924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.340038 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.340160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.340276 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.340389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.340502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.340622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.340736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.340857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.341001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.341117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.341232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.341355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.341478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.341593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.341706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.341817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.341930 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.342042 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.342162 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.342278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.342391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.342503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.342616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.342728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.342849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.342963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.343076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.343188 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.343301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.343414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.343534 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.343649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.343761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.343873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.343985 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.344097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.344218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.344332 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.344446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.344565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.344679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.344792 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.344913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.345112 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.345225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.345338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.345451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.345563 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.345688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.345803 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.345915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.346028 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.346140 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.346252 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.346372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.346488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.346601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.346713 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.346826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.346938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.347059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.347174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.347287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.347400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.347512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.347625 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.347751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.347866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.347979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.348091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.348203 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.348319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.348442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.348556 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.348669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.348781 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.348893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.349056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.349180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.349301 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.349415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.349527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.349641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.349754 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.349874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.349989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.350103 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.350215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.350328 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.350440 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.350564 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.350681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.350793 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.350906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.351018 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.351130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.351251 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.351366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.351479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.351591 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.351704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.351817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.351938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.352052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.352166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.352278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.352391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.352503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.352692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.352810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.352923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.353050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.353163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.353772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.353945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.354131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.354324 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.354476 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.354592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.354705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.354827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.354944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.355057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.355057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.355268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.355380 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.355500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.355614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.355726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.355838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.355951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.356071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.356194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.356308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.356420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.356532 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.356645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.356757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.356877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.357043 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.357159 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.357272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.357385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.357510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.357626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.357739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.357851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.357963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.358077 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.358200 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.358315 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.358428 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.358540 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.358653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.358765 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.358886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.359000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.359114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.359226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.359338 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.359451 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.359571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.359685 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.359798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] role.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.359917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.360031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] role.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.360145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.360265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.360380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.360493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.360606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.360718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.360831 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.360951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.361098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.361213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.361326 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.361438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.361551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.361676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.361792 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.361905 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.362018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.362130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.362243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.362364 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.362478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.362591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.362704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.362816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.362929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.363050 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.363164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.363278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.363391 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.363504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.363616 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.363737 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.363852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.363965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.364077 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.364190 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.364312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.364427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.364539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.364651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.364764 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.364876 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.365029 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.365146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.365259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.365373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.365485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.365597 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.365717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.365832 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.365945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.366057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.366160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.366255 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.366374 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.366490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.366603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.366716 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.366828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.366941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.367062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.367176 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.367289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.367401 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.367515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.367627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.367747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.367861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.367973 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.368089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.368201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.368313 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.368434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.368555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.368668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.368781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.368950 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.369642 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.369842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.370034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.370202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.370321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.370434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.370434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.370656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.370771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.370884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.370997 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.371109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.371221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.371342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.371455 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.371568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.371682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.371794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.371906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.372027 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.372141 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.372253 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.372365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.372478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.372590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.372712 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.372827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.372940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.373208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.373333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.373447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.373560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.373680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.373871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.374000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.374116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.374229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.374341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.374454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.374566 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.374687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.374802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.374916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.375028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.375140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.375252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.375373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.375488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.375601 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.375714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.375827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.375939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.376060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.376174 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.376287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.376399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.376512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.376624 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.376745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.376859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.376991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.377106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.377106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.377317 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.377441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 14:04:47.377557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.377557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.377557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:04:47.377557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 14:04:47.407258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.407418 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.407561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.407645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.407721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.407880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.416950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.417284 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.445062 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.445295 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.445951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.446188 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.501007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.501205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.551132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.551360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.552218 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.552459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.618795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.619214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.619415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.619522 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.619652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.619735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.619870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.619951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.620090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.620175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.620308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.620528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.643163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.643396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.643504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.643622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.643706 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.643848 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.643930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.644071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.644155 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.644290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.644373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.644510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.644601 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.644756 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.656489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.656814 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.669885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.670008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.670164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.670244 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.670442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.670514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.670672 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.670746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.670893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.670964 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.673179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.673304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.673390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.673467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 14:04:47.688593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.688807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 14:04:47.689040 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.689175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.689260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 14:04:47.689382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 14:04:47.689584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.689666 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.689793 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 14:04:47.689903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.690064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.690145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.690324 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.690405 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.690580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.690832 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.702081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.702275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.702360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.702554 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.702638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.702826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.702909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.703107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.711061 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.711280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.714917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.715214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.715297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.715586 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.715680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.715870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.715951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.716156 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.716236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.716424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.716507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.716683 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.716763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.716953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.717055 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.717247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.717329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.717516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.717596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.717785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.717874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.718051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.745478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.745573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.747103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.747202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.747382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.747464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.752703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.752794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.752944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.753045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.753254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.753376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.761213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.761494 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.761597 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.761780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.766108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.766396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.766478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.766685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.766785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.766970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.767058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.767240 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.767332 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.767511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.767593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.767777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.767859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.768043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.768131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.768310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.788016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.788293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.788417 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.788605 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.793104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.793338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.796767 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.797036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.797133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.797333 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.802114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.802427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.807298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.807716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.811007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.811308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.811448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.811595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.811748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.811878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.812035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.812154 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.812324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.812430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.812606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.812887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.937288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.937527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.937617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.937697 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.937846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.937930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.938111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.938205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.945998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.946086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.947732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.947833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.948006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.948105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.951296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.951388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.951576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.951659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.952029 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.952114 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.952313 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.952395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.952593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.952686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.966187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.966351 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.966467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.966630 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.966748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.966911 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.967041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.967236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.967326 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.967459 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.967601 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.967742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.967893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.968036 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.986887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.987001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.990187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.990274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.993572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.993656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.995803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.995959 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.997585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.997764 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:47.997850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.998045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.998129 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:47.998331 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.005545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.005722 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.007097 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:48.007337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:48.010423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.010654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.010740 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.010948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.011032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.011232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.011314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.011506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.020574 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:48.020815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:48.020899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.021139 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.021225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.021435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.029466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:48.029559 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 14:04:48.029747 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.029830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.030028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.030124 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.030314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.030398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.030587 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.030670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.030862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.030953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.031130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.031213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.031397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.031481 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.031681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.031764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.032048 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.032131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.032333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.032423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.032607 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.032689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.032873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.032953 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.033161 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.033247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 14:04:48.071990 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5584015e69c0 pid: 80176 (default app) Apr 12 14:04:48.072588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5584015e69c0 pid: 80175 (default app) Apr 12 14:04:48.075682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb265e5-6263-42fe-94c5-62de70b98aae None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:04:48.075976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb265e5-6263-42fe-94c5-62de70b98aae None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:04:48.076255 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb265e5-6263-42fe-94c5-62de70b98aae None None] PATH_INFO: `/v3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:04:48.080448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Tue Apr 12 14:04:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:04:57.371553 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3853-5386-47b1-afc9-f25c4ad419a3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:04:57.372125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3853-5386-47b1-afc9-f25c4ad419a3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:04:57.372125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3853-5386-47b1-afc9-f25c4ad419a3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:04:57.376450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:04:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:04:57.381899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf9a9d-ff54-4acc-bf5b-f44d0bbc4977 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:04:57.382319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf9a9d-ff54-4acc-bf5b-f44d0bbc4977 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:04:57.382462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf9a9d-ff54-4acc-bf5b-f44d0bbc4977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:04:57.412607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG oslo_db.sqlalchemy.engines [None req-21cf9a9d-ff54-4acc-bf5b-f44d0bbc4977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:04:57.602167 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG passlib.handlers.bcrypt [None req-21cf9a9d-ff54-4acc-bf5b-f44d0bbc4977 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80176) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 12 14:04:57.602587 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG passlib.handlers.bcrypt [None req-21cf9a9d-ff54-4acc-bf5b-f44d0bbc4977 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80176) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 12 14:04:57.657523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-21cf9a9d-ff54-4acc-bf5b-f44d0bbc4977 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:04:57.659111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-21cf9a9d-ff54-4acc-bf5b-f44d0bbc4977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:04:57.782524 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:04:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 12 14:04:57.936857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb3853-5386-47b1-afc9-f25c4ad419a3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:04:57.970446 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG oslo_db.sqlalchemy.engines [None req-c2fb3853-5386-47b1-afc9-f25c4ad419a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:04:58.100938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb3853-5386-47b1-afc9-f25c4ad419a3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:04:58.106244 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf465103-7095-43e4-9a47-6db91fa371d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:04:58.113930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf465103-7095-43e4-9a47-6db91fa371d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:04:58.113930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf465103-7095-43e4-9a47-6db91fa371d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:04:58.113930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf465103-7095-43e4-9a47-6db91fa371d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:04:58.116004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf465103-7095-43e4-9a47-6db91fa371d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:04:58.167056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bf465103-7095-43e4-9a47-6db91fa371d0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 12 14:04:58.167390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf465103-7095-43e4-9a47-6db91fa371d0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:04:58.176781 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Tue Apr 12 14:04:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:04:58.184242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf9a9d-ff54-4acc-bf5b-f44d0bbc4977 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:04:58.198523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf9a9d-ff54-4acc-bf5b-f44d0bbc4977 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:04:58.203131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffdaf3-9061-4fce-8d00-e7731989a56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:04:58.204260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffdaf3-9061-4fce-8d00-e7731989a56e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:04:58.204549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffdaf3-9061-4fce-8d00-e7731989a56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:04:58.204826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffdaf3-9061-4fce-8d00-e7731989a56e admin admin] PATH_INFO: `/v3/projects/1882ed88f2204017b2d59722788747c1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:04:58.206380 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffdaf3-9061-4fce-8d00-e7731989a56e admin admin] RBAC: Authorizing `identity:get_project(project_id=1882ed88f2204017b2d59722788747c1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:04:58.259132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d6ffdaf3-9061-4fce-8d00-e7731989a56e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 12 14:04:58.260008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffdaf3-9061-4fce-8d00-e7731989a56e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:04:58.264667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Tue Apr 12 14:04:58 2022] GET /identity/v3/projects/1882ed88f2204017b2d59722788747c1 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:00.552793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e7d77-f61e-476e-9514-3f5cadeb171c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:00.553343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e7d77-f61e-476e-9514-3f5cadeb171c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:00.553447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e7d77-f61e-476e-9514-3f5cadeb171c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:00.557539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:00.562777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174a4a-88a5-47aa-a09e-d49d0c66ac9c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:00.563208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174a4a-88a5-47aa-a09e-d49d0c66ac9c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:00.563350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff174a4a-88a5-47aa-a09e-d49d0c66ac9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:00.582327 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ff174a4a-88a5-47aa-a09e-d49d0c66ac9c None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:00.583849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ff174a4a-88a5-47aa-a09e-d49d0c66ac9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:00.592547 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 12 14:05:00.619790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e7d77-f61e-476e-9514-3f5cadeb171c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:00.631573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e7d77-f61e-476e-9514-3f5cadeb171c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:00.636754 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545249db-6126-42e7-a0bb-be66d1372c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:00.637406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545249db-6126-42e7-a0bb-be66d1372c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:00.637690 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545249db-6126-42e7-a0bb-be66d1372c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:00.637963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545249db-6126-42e7-a0bb-be66d1372c45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:00.645400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545249db-6126-42e7-a0bb-be66d1372c45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:00.647147 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545249db-6126-42e7-a0bb-be66d1372c45 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:00.656815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Tue Apr 12 14:05:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:05:00.663318 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff174a4a-88a5-47aa-a09e-d49d0c66ac9c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:00.672558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff174a4a-88a5-47aa-a09e-d49d0c66ac9c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:00.676927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da078935-e46d-4ad5-90e1-7865fd0f600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:00.677821 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da078935-e46d-4ad5-90e1-7865fd0f600d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:00.678107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da078935-e46d-4ad5-90e1-7865fd0f600d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:00.678383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da078935-e46d-4ad5-90e1-7865fd0f600d admin admin] PATH_INFO: `/v3/users/3d01d472ac8c4c32a41f169c9057727c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:00.679798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da078935-e46d-4ad5-90e1-7865fd0f600d admin admin] RBAC: Authorizing `identity:get_user(user_id=3d01d472ac8c4c32a41f169c9057727c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:00.681671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da078935-e46d-4ad5-90e1-7865fd0f600d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:00.683263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Tue Apr 12 14:05:00 2022] GET /identity/v3/users/3d01d472ac8c4c32a41f169c9057727c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:03.027827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e609faa-1ee1-4f09-90fe-970a1b4472c4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.028322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e609faa-1ee1-4f09-90fe-970a1b4472c4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.028322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e609faa-1ee1-4f09-90fe-970a1b4472c4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.029660 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:03.034626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd030d-c198-4376-8d9b-f50b62c24a43 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.035028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd030d-c198-4376-8d9b-f50b62c24a43 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.035259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd030d-c198-4376-8d9b-f50b62c24a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.052114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-05cd030d-c198-4376-8d9b-f50b62c24a43 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:03.053303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-05cd030d-c198-4376-8d9b-f50b62c24a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:03.081691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9012b-b84e-4f57-9db4-78516fc7cf0b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.081979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9012b-b84e-4f57-9db4-78516fc7cf0b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.082262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9012b-b84e-4f57-9db4-78516fc7cf0b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.083608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:03.088943 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a4e05-87ad-49c1-8c79-97369abffe3e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.089263 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a4e05-87ad-49c1-8c79-97369abffe3e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.089542 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a4e05-87ad-49c1-8c79-97369abffe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.129681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG passlib.handlers.bcrypt [None req-421a4e05-87ad-49c1-8c79-97369abffe3e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80175) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 12 14:05:03.130109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG passlib.handlers.bcrypt [None req-421a4e05-87ad-49c1-8c79-97369abffe3e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80175) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 12 14:05:03.131399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:03.156206 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd030d-c198-4376-8d9b-f50b62c24a43 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:03.177191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-421a4e05-87ad-49c1-8c79-97369abffe3e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:03.178815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-421a4e05-87ad-49c1-8c79-97369abffe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:03.250316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd030d-c198-4376-8d9b-f50b62c24a43 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:03.274434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:03.283378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3f0e7-7127-4886-a37d-9d05a5ac0195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:03.284109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3f0e7-7127-4886-a37d-9d05a5ac0195 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.284389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3f0e7-7127-4886-a37d-9d05a5ac0195 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.284661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3f0e7-7127-4886-a37d-9d05a5ac0195 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.295903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3f0e7-7127-4886-a37d-9d05a5ac0195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:03.297147 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a4e05-87ad-49c1-8c79-97369abffe3e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:03.302711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-78e3f0e7-7127-4886-a37d-9d05a5ac0195 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:05:03.303927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:05:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:03.309555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3f0e7-7127-4886-a37d-9d05a5ac0195 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:03.392426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a4e05-87ad-49c1-8c79-97369abffe3e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:03.402253 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3f0e7-7127-4886-a37d-9d05a5ac0195 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:03.427208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea12f6-7582-41ea-a939-ac81f567d37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:03.428101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea12f6-7582-41ea-a939-ac81f567d37a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.428386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea12f6-7582-41ea-a939-ac81f567d37a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.428671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea12f6-7582-41ea-a939-ac81f567d37a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.434128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9a0e-2f7b-4c85-93a5-a59a7c5443fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:03.434779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9a0e-2f7b-4c85-93a5-a59a7c5443fd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.435061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9a0e-2f7b-4c85-93a5-a59a7c5443fd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.435334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9a0e-2f7b-4c85-93a5-a59a7c5443fd None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.436075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f9a0e-2f7b-4c85-93a5-a59a7c5443fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:03.436383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f9a0e-2f7b-4c85-93a5-a59a7c5443fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:03.437814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f9a0e-2f7b-4c85-93a5-a59a7c5443fd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:03.449581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:03.454930 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9a0e-2f7b-4c85-93a5-a59a7c5443fd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:03.492654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea12f6-7582-41ea-a939-ac81f567d37a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:03.494430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea12f6-7582-41ea-a939-ac81f567d37a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:03.548194 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9a0e-2f7b-4c85-93a5-a59a7c5443fd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:03.579924 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90e90c-7725-417c-8a1b-4ffc1a134372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:03.580778 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90e90c-7725-417c-8a1b-4ffc1a134372 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.581085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90e90c-7725-417c-8a1b-4ffc1a134372 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.581359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90e90c-7725-417c-8a1b-4ffc1a134372 None admin] PATH_INFO: `/v3/users/3d01d472ac8c4c32a41f169c9057727c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.582544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90e90c-7725-417c-8a1b-4ffc1a134372 None admin] RBAC: Authorizing `identity:get_user(user_id=3d01d472ac8c4c32a41f169c9057727c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:03.583989 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90e90c-7725-417c-8a1b-4ffc1a134372 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:03.585647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 9/16] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:03 2022] GET /identity/v3/users/3d01d472ac8c4c32a41f169c9057727c => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:03.587629 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 8/17] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 14:05:03.591435 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90e90c-7725-417c-8a1b-4ffc1a134372 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:03.594327 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea12f6-7582-41ea-a939-ac81f567d37a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:03.686696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90e90c-7725-417c-8a1b-4ffc1a134372 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:03.687154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea12f6-7582-41ea-a939-ac81f567d37a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:03.718971 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6fe6d-4c98-418a-9879-438e443ce82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:03.719761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6fe6d-4c98-418a-9879-438e443ce82b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.720047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6fe6d-4c98-418a-9879-438e443ce82b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.720138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a327bc4-4a42-4855-820d-739d45ae4ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:03.720325 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6fe6d-4c98-418a-9879-438e443ce82b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.720919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327bc4-4a42-4855-820d-739d45ae4ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.721234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327bc4-4a42-4855-820d-739d45ae4ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.721510 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327bc4-4a42-4855-820d-739d45ae4ce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.721593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6fe6d-4c98-418a-9879-438e443ce82b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:03.722982 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6fe6d-4c98-418a-9879-438e443ce82b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:03.724589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 10/18] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:03.730862 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6fe6d-4c98-418a-9879-438e443ce82b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:03.742412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a327bc4-4a42-4855-820d-739d45ae4ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:03.745200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a327bc4-4a42-4855-820d-739d45ae4ce5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:03.762035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-4a327bc4-4a42-4855-820d-739d45ae4ce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:05:03.763229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 9/19] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:03.768725 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a327bc4-4a42-4855-820d-739d45ae4ce5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:03.824610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6fe6d-4c98-418a-9879-438e443ce82b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:03.856043 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b916944-ba53-40d8-b4c0-5571976d81b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:03.856691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916944-ba53-40d8-b4c0-5571976d81b5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.856998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916944-ba53-40d8-b4c0-5571976d81b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.857642 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916944-ba53-40d8-b4c0-5571976d81b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.858465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b916944-ba53-40d8-b4c0-5571976d81b5 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.domain.id=default, user.id=3d01d472ac8c4c32a41f169c9057727c) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:03.858775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b916944-ba53-40d8-b4c0-5571976d81b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:03.860190 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b916944-ba53-40d8-b4c0-5571976d81b5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:03.863655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a327bc4-4a42-4855-820d-739d45ae4ce5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:03.866693 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 11/20] 10.222.0.61 () {56 vars in 1322 bytes} [Tue Apr 12 14:05:03 2022] GET /identity/v3/role_assignments?user.id=3d01d472ac8c4c32a41f169c9057727c&scope.domain.id=default&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:03.898072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df16ad2-b29d-42d3-b048-88b261c8820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:03.898756 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df16ad2-b29d-42d3-b048-88b261c8820d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:03.899040 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df16ad2-b29d-42d3-b048-88b261c8820d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:03.899317 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df16ad2-b29d-42d3-b048-88b261c8820d None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:03.900596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df16ad2-b29d-42d3-b048-88b261c8820d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:03.900909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df16ad2-b29d-42d3-b048-88b261c8820d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:03.902341 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df16ad2-b29d-42d3-b048-88b261c8820d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:03.921955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 10/21] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:06.438194 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537972cd-78b4-4f94-b194-a1857a1f097f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:06.438733 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537972cd-78b4-4f94-b194-a1857a1f097f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:06.438733 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537972cd-78b4-4f94-b194-a1857a1f097f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:06.440114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 12/22] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:06.445500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20120483-3862-451d-9578-78023968c379 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:06.445905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20120483-3862-451d-9578-78023968c379 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:06.446067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20120483-3862-451d-9578-78023968c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:06.473471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-20120483-3862-451d-9578-78023968c379 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:06.474701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-20120483-3862-451d-9578-78023968c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:06.564629 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 11/23] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:06.601602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537972cd-78b4-4f94-b194-a1857a1f097f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:06.723148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537972cd-78b4-4f94-b194-a1857a1f097f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:06.765245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d5b17-3bba-479f-88ff-10d1a67da95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:06.766038 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d5b17-3bba-479f-88ff-10d1a67da95e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:06.766319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d5b17-3bba-479f-88ff-10d1a67da95e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:06.766589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d5b17-3bba-479f-88ff-10d1a67da95e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:06.784035 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d5b17-3bba-479f-88ff-10d1a67da95e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:06.791385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-078d5b17-3bba-479f-88ff-10d1a67da95e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:05:06.792938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 13/24] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:06.798508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20120483-3862-451d-9578-78023968c379 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:06.919394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20120483-3862-451d-9578-78023968c379 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:06.923589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6636b-54e1-4f10-9903-741de744fad3 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:06.923881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6636b-54e1-4f10-9903-741de744fad3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:06.924160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6636b-54e1-4f10-9903-741de744fad3 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:06.926116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 14/25] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:06.931731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10352869-77e2-439b-b3eb-3c42908d0555 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:06.932027 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10352869-77e2-439b-b3eb-3c42908d0555 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:06.932282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10352869-77e2-439b-b3eb-3c42908d0555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:06.953534 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-10352869-77e2-439b-b3eb-3c42908d0555 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:06.955077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-10352869-77e2-439b-b3eb-3c42908d0555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:06.982259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb438-1ca2-45b8-9992-bcaa8214b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:06.983415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb438-1ca2-45b8-9992-bcaa8214b6db None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:06.983835 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb438-1ca2-45b8-9992-bcaa8214b6db None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:06.984133 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb438-1ca2-45b8-9992-bcaa8214b6db None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:06.984906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb438-1ca2-45b8-9992-bcaa8214b6db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:06.985256 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb438-1ca2-45b8-9992-bcaa8214b6db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:06.987205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb438-1ca2-45b8-9992-bcaa8214b6db None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:07.028766 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 12/26] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:07.037596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb438-1ca2-45b8-9992-bcaa8214b6db None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:07.093613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 15/27] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:07.129684 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10352869-77e2-439b-b3eb-3c42908d0555 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:07.186927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb438-1ca2-45b8-9992-bcaa8214b6db None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:07.235745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32168f-7a37-4f46-86eb-5f654eeaead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:07.236866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32168f-7a37-4f46-86eb-5f654eeaead1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:07.237346 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32168f-7a37-4f46-86eb-5f654eeaead1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:07.237765 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32168f-7a37-4f46-86eb-5f654eeaead1 None admin] PATH_INFO: `/v3/users/3d01d472ac8c4c32a41f169c9057727c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:07.239477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32168f-7a37-4f46-86eb-5f654eeaead1 None admin] RBAC: Authorizing `identity:get_user(user_id=3d01d472ac8c4c32a41f169c9057727c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:07.241113 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32168f-7a37-4f46-86eb-5f654eeaead1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:07.244008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 13/28] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:07 2022] GET /identity/v3/users/3d01d472ac8c4c32a41f169c9057727c => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:07.249412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32168f-7a37-4f46-86eb-5f654eeaead1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:07.351912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10352869-77e2-439b-b3eb-3c42908d0555 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:07.378351 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32168f-7a37-4f46-86eb-5f654eeaead1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:07.413758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e55a5-6ac7-456b-9ceb-3483d2b09e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:07.414798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e55a5-6ac7-456b-9ceb-3483d2b09e43 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:07.415773 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e55a5-6ac7-456b-9ceb-3483d2b09e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:07.416194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e55a5-6ac7-456b-9ceb-3483d2b09e43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:07.417576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e55a5-6ac7-456b-9ceb-3483d2b09e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:07.419248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e55a5-6ac7-456b-9ceb-3483d2b09e43 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:07.421488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 14/29] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:07.427006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e55a5-6ac7-456b-9ceb-3483d2b09e43 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:07.433908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefde7d-c683-46f4-9368-7d45cd8e78eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:07.434827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefde7d-c683-46f4-9368-7d45cd8e78eb None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:07.435327 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefde7d-c683-46f4-9368-7d45cd8e78eb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:07.435752 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefde7d-c683-46f4-9368-7d45cd8e78eb None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:07.436666 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefde7d-c683-46f4-9368-7d45cd8e78eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:07.438229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefde7d-c683-46f4-9368-7d45cd8e78eb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:07.543678 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e55a5-6ac7-456b-9ceb-3483d2b09e43 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:07.578876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bba898-5336-4228-954d-f4816a8c66fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:07.579780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bba898-5336-4228-954d-f4816a8c66fb None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:07.580070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bba898-5336-4228-954d-f4816a8c66fb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:07.580362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bba898-5336-4228-954d-f4816a8c66fb None admin] PATH_INFO: `/v3/domains/default/users/3d01d472ac8c4c32a41f169c9057727c/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:07.582592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bba898-5336-4228-954d-f4816a8c66fb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3d01d472ac8c4c32a41f169c9057727c, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:07.584100 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bba898-5336-4228-954d-f4816a8c66fb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:07.690875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 16/30] 10.222.0.61 () {60 vars in 1131 bytes} [Tue Apr 12 14:05:07 2022] POST /identity/v3/roles => generated 219 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:05:07.693103 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e766c-e489-490f-a031-e5e017bbeb72 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:07.693606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e766c-e489-490f-a031-e5e017bbeb72 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:07.694148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e766c-e489-490f-a031-e5e017bbeb72 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:07.697709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 17/31] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:07.699741 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad773-9867-4c58-9ede-01056c93b80c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:07.700246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad773-9867-4c58-9ede-01056c93b80c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:07.700745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad773-9867-4c58-9ede-01056c93b80c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:07.702751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 18/32] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:07.704186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4aee5e-e599-4c08-9227-33727914dcdf None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:07.704703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4aee5e-e599-4c08-9227-33727914dcdf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:07.705197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4aee5e-e599-4c08-9227-33727914dcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:07.723757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-dc4aee5e-e599-4c08-9227-33727914dcdf None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:07.726031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dc4aee5e-e599-4c08-9227-33727914dcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:07.765036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 15/33] 10.222.0.61 () {58 vars in 1361 bytes} [Tue Apr 12 14:05:07 2022] PUT /identity/v3/domains/default/users/3d01d472ac8c4c32a41f169c9057727c/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:05:07.767276 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4c72a-9c35-4de7-9788-62a7ad87cdd9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:07.767757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4c72a-9c35-4de7-9788-62a7ad87cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:07.768217 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4c72a-9c35-4de7-9788-62a7ad87cdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:07.787751 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a5c4c72a-9c35-4de7-9788-62a7ad87cdd9 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:07.789603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a5c4c72a-9c35-4de7-9788-62a7ad87cdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:07.841459 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 19/34] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:07.868593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 16/35] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:07.878569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4aee5e-e599-4c08-9227-33727914dcdf None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:07.920008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4c72a-9c35-4de7-9788-62a7ad87cdd9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:08.041234 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4aee5e-e599-4c08-9227-33727914dcdf None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:08.114772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b063c-7f51-4854-b357-73f5167373af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:08.115399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b063c-7f51-4854-b357-73f5167373af None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:08.115691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b063c-7f51-4854-b357-73f5167373af None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:08.115970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b063c-7f51-4854-b357-73f5167373af None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:08.116763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b063c-7f51-4854-b357-73f5167373af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:08.119928 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b063c-7f51-4854-b357-73f5167373af None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:08.121294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4c72a-9c35-4de7-9788-62a7ad87cdd9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:08.162561 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85cd1c-0388-4968-bfa6-bcef18c45230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:08.163384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85cd1c-0388-4968-bfa6-bcef18c45230 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:08.163671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85cd1c-0388-4968-bfa6-bcef18c45230 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:08.163949 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85cd1c-0388-4968-bfa6-bcef18c45230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:08.176116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85cd1c-0388-4968-bfa6-bcef18c45230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:08.178115 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85cd1c-0388-4968-bfa6-bcef18c45230 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:08.195808 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-0b85cd1c-0388-4968-bfa6-bcef18c45230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:05:08.197874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 17/36] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:08.199197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14fd2-d5fd-4c43-9264-3b4467d122a9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:08.199487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14fd2-d5fd-4c43-9264-3b4467d122a9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:08.199763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14fd2-d5fd-4c43-9264-3b4467d122a9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:08.203898 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 18/37] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:08.204611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db14fd2-d5fd-4c43-9264-3b4467d122a9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:08.226526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 20/38] 10.222.0.61 () {60 vars in 1131 bytes} [Tue Apr 12 14:05:07 2022] POST /identity/v3/roles => generated 225 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:08.229249 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948dfd9-45bd-491e-8340-4996f4572dc3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:08.229544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948dfd9-45bd-491e-8340-4996f4572dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:08.229827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948dfd9-45bd-491e-8340-4996f4572dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:08.253334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7948dfd9-45bd-491e-8340-4996f4572dc3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:08.255417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7948dfd9-45bd-491e-8340-4996f4572dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:08.320357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db14fd2-d5fd-4c43-9264-3b4467d122a9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:08.353092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 21/39] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:08.375347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040b188-8223-4bbe-a9a8-0cfc10399a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:08.376008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040b188-8223-4bbe-a9a8-0cfc10399a62 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:08.376299 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040b188-8223-4bbe-a9a8-0cfc10399a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:08.377011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040b188-8223-4bbe-a9a8-0cfc10399a62 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:08.377793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040b188-8223-4bbe-a9a8-0cfc10399a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:08.377886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948dfd9-45bd-491e-8340-4996f4572dc3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:08.378194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040b188-8223-4bbe-a9a8-0cfc10399a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:08.379773 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040b188-8223-4bbe-a9a8-0cfc10399a62 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:08.407245 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 19/40] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:08.423762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040b188-8223-4bbe-a9a8-0cfc10399a62 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:08.499256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948dfd9-45bd-491e-8340-4996f4572dc3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:08.545342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378d5e1-362b-42d6-aac1-a85aa956f90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:08.546019 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d5e1-362b-42d6-aac1-a85aa956f90d None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:08.546618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d5e1-362b-42d6-aac1-a85aa956f90d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:08.547042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d5e1-362b-42d6-aac1-a85aa956f90d None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:08.548696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378d5e1-362b-42d6-aac1-a85aa956f90d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:08.550255 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378d5e1-362b-42d6-aac1-a85aa956f90d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:08.578011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040b188-8223-4bbe-a9a8-0cfc10399a62 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:08.617611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293f84a-8aa2-4a35-bd76-a2eef5311dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:08.618797 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293f84a-8aa2-4a35-bd76-a2eef5311dcf None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:08.619260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293f84a-8aa2-4a35-bd76-a2eef5311dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:08.619539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293f84a-8aa2-4a35-bd76-a2eef5311dcf None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:08.620257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293f84a-8aa2-4a35-bd76-a2eef5311dcf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:08.621770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293f84a-8aa2-4a35-bd76-a2eef5311dcf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:08.639136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 22/41] 10.222.0.61 () {60 vars in 1131 bytes} [Tue Apr 12 14:05:08 2022] POST /identity/v3/roles => generated 223 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:05:08.640322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082273-02af-414b-9109-6e99a302a5df None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:08.640665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082273-02af-414b-9109-6e99a302a5df None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:08.641025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082273-02af-414b-9109-6e99a302a5df None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:08.642513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 23/42] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:08.648167 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a410de7-adee-44a9-b4e6-571e951d0db3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:08.648461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a410de7-adee-44a9-b4e6-571e951d0db3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:08.648743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a410de7-adee-44a9-b4e6-571e951d0db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:08.670061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1a410de7-adee-44a9-b4e6-571e951d0db3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:08.670939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1a410de7-adee-44a9-b4e6-571e951d0db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:08.729815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 20/43] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:05:08 2022] POST /identity/v3/projects => generated 301 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:05:08.756881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 24/44] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:08.784428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293f84a-8aa2-4a35-bd76-a2eef5311dcf None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:08.908357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293f84a-8aa2-4a35-bd76-a2eef5311dcf None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:08.947194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc10094-27b2-4454-8c55-f3f40c858282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:08.948017 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc10094-27b2-4454-8c55-f3f40c858282 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:08.948309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc10094-27b2-4454-8c55-f3f40c858282 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:08.948846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc10094-27b2-4454-8c55-f3f40c858282 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:08.950107 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc10094-27b2-4454-8c55-f3f40c858282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:08.951555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc10094-27b2-4454-8c55-f3f40c858282 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:08.953240 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 21/45] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:08.958795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a410de7-adee-44a9-b4e6-571e951d0db3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:09.054767 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a410de7-adee-44a9-b4e6-571e951d0db3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:09.089321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef2abc-6722-464d-aba4-0a1d66f4a388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:09.089981 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2abc-6722-464d-aba4-0a1d66f4a388 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:09.090264 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2abc-6722-464d-aba4-0a1d66f4a388 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:09.090548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2abc-6722-464d-aba4-0a1d66f4a388 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:09.091259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef2abc-6722-464d-aba4-0a1d66f4a388 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:09.092702 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef2abc-6722-464d-aba4-0a1d66f4a388 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:09.186082 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 25/46] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:05:08 2022] POST /identity/v3/projects => generated 312 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:10.342620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f9fc2-8106-4d40-b34d-0434cac0290a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:10.343138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f9fc2-8106-4d40-b34d-0434cac0290a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:10.343250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f9fc2-8106-4d40-b34d-0434cac0290a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:10.344569 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 22/47] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:10.349874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e17e-fc54-439b-b935-725c634803f7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:10.350462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e17e-fc54-439b-b935-725c634803f7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:10.350751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e17e-fc54-439b-b935-725c634803f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:10.367106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c524e17e-fc54-439b-b935-725c634803f7 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:10.368360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c524e17e-fc54-439b-b935-725c634803f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:10.431343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 26/48] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:10.456433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f9fc2-8106-4d40-b34d-0434cac0290a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:10.553466 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f9fc2-8106-4d40-b34d-0434cac0290a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:10.584662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571ba5-e649-4ece-910d-8610e747018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:10.585469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571ba5-e649-4ece-910d-8610e747018d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:10.585753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571ba5-e649-4ece-910d-8610e747018d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:10.586028 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571ba5-e649-4ece-910d-8610e747018d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:10.597589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed571ba5-e649-4ece-910d-8610e747018d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:10.604480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-ed571ba5-e649-4ece-910d-8610e747018d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:05:10.605685 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 23/49] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:05:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:10.611440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524e17e-fc54-439b-b935-725c634803f7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:10.706279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524e17e-fc54-439b-b935-725c634803f7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:10.737968 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85fcc0-2657-4b74-ade7-025da69098c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:10.738638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85fcc0-2657-4b74-ade7-025da69098c7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:10.738921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85fcc0-2657-4b74-ade7-025da69098c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:10.739198 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85fcc0-2657-4b74-ade7-025da69098c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:10.739940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85fcc0-2657-4b74-ade7-025da69098c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:10.740253 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85fcc0-2657-4b74-ade7-025da69098c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:10.741660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85fcc0-2657-4b74-ade7-025da69098c7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:10.750247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 27/50] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:10.755621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571ba5-e649-4ece-910d-8610e747018d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:10.856676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571ba5-e649-4ece-910d-8610e747018d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:10.887923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5998b6c-f775-474f-88bb-fb201cc4c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:10.888788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5998b6c-f775-474f-88bb-fb201cc4c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:10.889100 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5998b6c-f775-474f-88bb-fb201cc4c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:10.889378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5998b6c-f775-474f-88bb-fb201cc4c0a0 None admin] PATH_INFO: `/v3/users/3d01d472ac8c4c32a41f169c9057727c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:10.890578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5998b6c-f775-474f-88bb-fb201cc4c0a0 None admin] RBAC: Authorizing `identity:get_user(user_id=3d01d472ac8c4c32a41f169c9057727c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:10.892036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5998b6c-f775-474f-88bb-fb201cc4c0a0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:10.893705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 24/51] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:10 2022] GET /identity/v3/users/3d01d472ac8c4c32a41f169c9057727c => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:10.899989 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85fcc0-2657-4b74-ade7-025da69098c7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:10.997985 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85fcc0-2657-4b74-ade7-025da69098c7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:11.030277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63bff9-7c94-4bfe-82b8-c180526d5f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:11.031067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63bff9-7c94-4bfe-82b8-c180526d5f64 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:11.031355 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63bff9-7c94-4bfe-82b8-c180526d5f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:11.031636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63bff9-7c94-4bfe-82b8-c180526d5f64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:11.032801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63bff9-7c94-4bfe-82b8-c180526d5f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:11.034270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63bff9-7c94-4bfe-82b8-c180526d5f64 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:11.035887 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 28/52] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:11.041530 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5998b6c-f775-474f-88bb-fb201cc4c0a0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:11.138681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5998b6c-f775-474f-88bb-fb201cc4c0a0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:11.172991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f35a6-41cb-4e9c-9350-6985561cdf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:11.173657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f35a6-41cb-4e9c-9350-6985561cdf27 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:11.173945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f35a6-41cb-4e9c-9350-6985561cdf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:11.174226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f35a6-41cb-4e9c-9350-6985561cdf27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:11.175057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f35a6-41cb-4e9c-9350-6985561cdf27 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.domain.id=default, user.id=3d01d472ac8c4c32a41f169c9057727c) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:11.175377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f35a6-41cb-4e9c-9350-6985561cdf27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:11.176819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f35a6-41cb-4e9c-9350-6985561cdf27 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:11.184794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 25/53] 10.222.0.61 () {56 vars in 1322 bytes} [Tue Apr 12 14:05:11 2022] GET /identity/v3/role_assignments?user.id=3d01d472ac8c4c32a41f169c9057727c&scope.domain.id=default&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:11.514010 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a58b-2c25-4f89-829b-c804a57b7a50 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:11.514527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a58b-2c25-4f89-829b-c804a57b7a50 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:11.514628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a58b-2c25-4f89-829b-c804a57b7a50 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:11.515954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 29/54] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:11.521137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c3360-6a87-4c04-942b-091a417ad4cf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:11.521494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c3360-6a87-4c04-942b-091a417ad4cf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:11.521713 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c3360-6a87-4c04-942b-091a417ad4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:11.538038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-dd3c3360-6a87-4c04-942b-091a417ad4cf None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:11.539245 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dd3c3360-6a87-4c04-942b-091a417ad4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:11.602668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 26/55] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:11.627404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0a58b-2c25-4f89-829b-c804a57b7a50 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:11.725205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0a58b-2c25-4f89-829b-c804a57b7a50 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:11.757899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48ae5b-db8f-4a93-b48c-fa1f686cce93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:11.758879 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48ae5b-db8f-4a93-b48c-fa1f686cce93 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:11.759160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48ae5b-db8f-4a93-b48c-fa1f686cce93 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:11.759436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48ae5b-db8f-4a93-b48c-fa1f686cce93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:11.760600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48ae5b-db8f-4a93-b48c-fa1f686cce93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:11.762086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48ae5b-db8f-4a93-b48c-fa1f686cce93 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:11.763695 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 30/56] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:11.769269 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c3360-6a87-4c04-942b-091a417ad4cf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:11.861778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c3360-6a87-4c04-942b-091a417ad4cf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:11.894192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf17a7e-96eb-4844-a22a-5a29cb4ee1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:11.894850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17a7e-96eb-4844-a22a-5a29cb4ee1fb None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:11.895142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17a7e-96eb-4844-a22a-5a29cb4ee1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:11.895424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17a7e-96eb-4844-a22a-5a29cb4ee1fb None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:11.896141 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf17a7e-96eb-4844-a22a-5a29cb4ee1fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:11.897625 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf17a7e-96eb-4844-a22a-5a29cb4ee1fb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:11.990543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 27/57] 10.222.0.61 () {60 vars in 1140 bytes} [Tue Apr 12 14:05:11 2022] POST /identity/v3/projects => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:14.271530 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc606c-a5ac-4dcf-bb9e-2c201196b7ca None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:14.272070 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc606c-a5ac-4dcf-bb9e-2c201196b7ca None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:14.272070 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc606c-a5ac-4dcf-bb9e-2c201196b7ca None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:14.273486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 31/58] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:14.279425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02d25f-5862-498b-ba54-9f03016c509d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:14.279839 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02d25f-5862-498b-ba54-9f03016c509d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:14.279989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02d25f-5862-498b-ba54-9f03016c509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:14.296262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5a02d25f-5862-498b-ba54-9f03016c509d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:14.297490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5a02d25f-5862-498b-ba54-9f03016c509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:14.359658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 28/59] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:14.386478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc606c-a5ac-4dcf-bb9e-2c201196b7ca None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:14.480223 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc606c-a5ac-4dcf-bb9e-2c201196b7ca None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:14.512210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daeb14-26a5-4861-b581-824909222b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:14.513003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daeb14-26a5-4861-b581-824909222b20 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:14.513289 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daeb14-26a5-4861-b581-824909222b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:14.513559 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daeb14-26a5-4861-b581-824909222b20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:14.514706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daeb14-26a5-4861-b581-824909222b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:14.516158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daeb14-26a5-4861-b581-824909222b20 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:14.517787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 32/60] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:14.523143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02d25f-5862-498b-ba54-9f03016c509d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:14.615409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02d25f-5862-498b-ba54-9f03016c509d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:14.647286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea1443-2c9a-44c0-b50a-be74c45bd085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:14.647944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1443-2c9a-44c0-b50a-be74c45bd085 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:14.648232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1443-2c9a-44c0-b50a-be74c45bd085 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:14.648512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1443-2c9a-44c0-b50a-be74c45bd085 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:14.649274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea1443-2c9a-44c0-b50a-be74c45bd085 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:14.650709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea1443-2c9a-44c0-b50a-be74c45bd085 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:14.761506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 29/61] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:05:14 2022] POST /identity/v3/users => generated 275 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:18.272745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d89cff-0862-422b-b688-9c8f997c5021 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.274463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d89cff-0862-422b-b688-9c8f997c5021 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.274954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d89cff-0862-422b-b688-9c8f997c5021 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.276851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 33/62] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:18.281957 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eada82-8c33-4cc1-81e1-4f73051fc593 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.282807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eada82-8c33-4cc1-81e1-4f73051fc593 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.283286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eada82-8c33-4cc1-81e1-4f73051fc593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.310011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-29eada82-8c33-4cc1-81e1-4f73051fc593 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:18.311582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-29eada82-8c33-4cc1-81e1-4f73051fc593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:18.336943 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219378-1e0f-4f27-a76f-4295fe75d979 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.337570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219378-1e0f-4f27-a76f-4295fe75d979 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.338091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219378-1e0f-4f27-a76f-4295fe75d979 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.339668 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 34/63] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:18.345329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1465f-0aee-4be3-8dfc-40dc8f9c4a73 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.345868 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1465f-0aee-4be3-8dfc-40dc8f9c4a73 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.346353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1465f-0aee-4be3-8dfc-40dc8f9c4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.382169 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8eb1465f-0aee-4be3-8dfc-40dc8f9c4a73 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:18.384086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8eb1465f-0aee-4be3-8dfc-40dc8f9c4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:18.434606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 30/64] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:18.489648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 35/65] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:18.514451 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eada82-8c33-4cc1-81e1-4f73051fc593 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:18.527462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1465f-0aee-4be3-8dfc-40dc8f9c4a73 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:18.631044 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eada82-8c33-4cc1-81e1-4f73051fc593 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:18.660875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1465f-0aee-4be3-8dfc-40dc8f9c4a73 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:18.674146 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4d878-c721-4245-a391-52413613beba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:18.675131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4d878-c721-4245-a391-52413613beba None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.675578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4d878-c721-4245-a391-52413613beba None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.676010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4d878-c721-4245-a391-52413613beba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.690171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4d878-c721-4245-a391-52413613beba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:18.699951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-bed4d878-c721-4245-a391-52413613beba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:18.701648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 31/66] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:18.704341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bd154-67df-45f2-af75-4fe287148519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:18.705370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bd154-67df-45f2-af75-4fe287148519 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.705797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bd154-67df-45f2-af75-4fe287148519 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.706216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bd154-67df-45f2-af75-4fe287148519 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.707548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee434-f57a-409c-90b7-cd36b8b151a6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.707842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee434-f57a-409c-90b7-cd36b8b151a6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.708122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee434-f57a-409c-90b7-cd36b8b151a6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.710441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 32/67] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:18.711336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaee434-f57a-409c-90b7-cd36b8b151a6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:18.722864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bd154-67df-45f2-af75-4fe287148519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:18.732383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-a26bd154-67df-45f2-af75-4fe287148519 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:05:18.734359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 36/68] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:05:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:18.735759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c943f-71f8-4c80-ac4a-6681d9eb3bc5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.736192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c943f-71f8-4c80-ac4a-6681d9eb3bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.736613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c943f-71f8-4c80-ac4a-6681d9eb3bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.758512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b42c943f-71f8-4c80-ac4a-6681d9eb3bc5 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:18.760843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b42c943f-71f8-4c80-ac4a-6681d9eb3bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:18.826005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaee434-f57a-409c-90b7-cd36b8b151a6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:18.829729 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 37/69] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:18.830457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c943f-71f8-4c80-ac4a-6681d9eb3bc5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:18.859066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a352d2d-1e1e-4f10-8aec-973dca3b5ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:18.859746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352d2d-1e1e-4f10-8aec-973dca3b5ccf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.860037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352d2d-1e1e-4f10-8aec-973dca3b5ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.860319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352d2d-1e1e-4f10-8aec-973dca3b5ccf None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.861096 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a352d2d-1e1e-4f10-8aec-973dca3b5ccf None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:18.861413 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a352d2d-1e1e-4f10-8aec-973dca3b5ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:18.862802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a352d2d-1e1e-4f10-8aec-973dca3b5ccf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:18.871978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 33/70] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:18.871978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52157-1f68-4e83-88fd-88ea6ecbded2 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.871978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52157-1f68-4e83-88fd-88ea6ecbded2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.871978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52157-1f68-4e83-88fd-88ea6ecbded2 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.871978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 34/71] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:18.871978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c7c4-4495-4324-8242-94d8ef134a19 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.871978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c7c4-4495-4324-8242-94d8ef134a19 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.877250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c7c4-4495-4324-8242-94d8ef134a19 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.877806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 35/72] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:18.878479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676c7c4-4495-4324-8242-94d8ef134a19 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:18.934117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c943f-71f8-4c80-ac4a-6681d9eb3bc5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:18.965807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8611619-4dcb-4065-b7df-e5e9cb3c3fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:18.966464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611619-4dcb-4065-b7df-e5e9cb3c3fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:18.966751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611619-4dcb-4065-b7df-e5e9cb3c3fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:18.967030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611619-4dcb-4065-b7df-e5e9cb3c3fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:18.967774 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8611619-4dcb-4065-b7df-e5e9cb3c3fd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:18.968084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8611619-4dcb-4065-b7df-e5e9cb3c3fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:18.969498 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8611619-4dcb-4065-b7df-e5e9cb3c3fd9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:18.975113 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676c7c4-4495-4324-8242-94d8ef134a19 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:18.977903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 38/73] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:18.977903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8611619-4dcb-4065-b7df-e5e9cb3c3fd9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:19.007761 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e9e74-f864-4713-821f-7d45689926be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:19.008646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9e74-f864-4713-821f-7d45689926be None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.008934 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9e74-f864-4713-821f-7d45689926be None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.009239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9e74-f864-4713-821f-7d45689926be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.018807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e9e74-f864-4713-821f-7d45689926be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:19.026787 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-d07e9e74-f864-4713-821f-7d45689926be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:05:19.027979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 36/74] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:05:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:19.029147 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dca92-ce29-4049-8fcf-446bac4ec659 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.029440 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dca92-ce29-4049-8fcf-446bac4ec659 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.029720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dca92-ce29-4049-8fcf-446bac4ec659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.045621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e84dca92-ce29-4049-8fcf-446bac4ec659 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:19.046809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e84dca92-ce29-4049-8fcf-446bac4ec659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:19.075504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8611619-4dcb-4065-b7df-e5e9cb3c3fd9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:19.108751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265509d-908e-4744-a8dd-8ca574080fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:19.109570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265509d-908e-4744-a8dd-8ca574080fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.109858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265509d-908e-4744-a8dd-8ca574080fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.110137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265509d-908e-4744-a8dd-8ca574080fe9 None admin] PATH_INFO: `/v3/users/55c387b4a9af4a1d99f620de2f727870` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.110675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 37/75] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:19.111923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991fdca-b411-4053-a52f-f66f63af1619 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.112224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991fdca-b411-4053-a52f-f66f63af1619 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.112504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991fdca-b411-4053-a52f-f66f63af1619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.129896 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265509d-908e-4744-a8dd-8ca574080fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=55c387b4a9af4a1d99f620de2f727870)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:19.131303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1991fdca-b411-4053-a52f-f66f63af1619 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:19.131408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265509d-908e-4744-a8dd-8ca574080fe9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:19.132483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1991fdca-b411-4053-a52f-f66f63af1619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:19.133202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 39/76] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:18 2022] GET /identity/v3/users/55c387b4a9af4a1d99f620de2f727870 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:19.133972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265509d-908e-4744-a8dd-8ca574080fe9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:19.196582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 38/77] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:19.203996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991fdca-b411-4053-a52f-f66f63af1619 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:19.228995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265509d-908e-4744-a8dd-8ca574080fe9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:19.261909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11ae79-09af-40e7-a52e-1e1ca129204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:19.262778 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ae79-09af-40e7-a52e-1e1ca129204e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.263047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ae79-09af-40e7-a52e-1e1ca129204e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.263314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ae79-09af-40e7-a52e-1e1ca129204e None admin] PATH_INFO: `/v3/users/3d01d472ac8c4c32a41f169c9057727c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.264601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11ae79-09af-40e7-a52e-1e1ca129204e None admin] RBAC: Authorizing `identity:get_user(user_id=3d01d472ac8c4c32a41f169c9057727c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:19.266177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11ae79-09af-40e7-a52e-1e1ca129204e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:19.267824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 40/78] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:19 2022] GET /identity/v3/users/3d01d472ac8c4c32a41f169c9057727c => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:19.268593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11ae79-09af-40e7-a52e-1e1ca129204e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:19.300921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991fdca-b411-4053-a52f-f66f63af1619 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:19.333380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad12ca3-4c39-4719-b092-ef2fe8587383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:19.334051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad12ca3-4c39-4719-b092-ef2fe8587383 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.334341 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad12ca3-4c39-4719-b092-ef2fe8587383 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.334626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad12ca3-4c39-4719-b092-ef2fe8587383 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.335377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad12ca3-4c39-4719-b092-ef2fe8587383 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:19.335693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad12ca3-4c39-4719-b092-ef2fe8587383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:19.337813 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad12ca3-4c39-4719-b092-ef2fe8587383 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:19.345468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 39/79] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:05:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:19.346253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad12ca3-4c39-4719-b092-ef2fe8587383 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:19.366137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11ae79-09af-40e7-a52e-1e1ca129204e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:19.399585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64213d1-6c68-4e7b-a0c0-4d93b0624e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:19.400389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64213d1-6c68-4e7b-a0c0-4d93b0624e7b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.400679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64213d1-6c68-4e7b-a0c0-4d93b0624e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.400969 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64213d1-6c68-4e7b-a0c0-4d93b0624e7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.410679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64213d1-6c68-4e7b-a0c0-4d93b0624e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:19.417674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-a64213d1-6c68-4e7b-a0c0-4d93b0624e7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:19.418872 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 41/80] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:19.419650 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64213d1-6c68-4e7b-a0c0-4d93b0624e7b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:19.439963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad12ca3-4c39-4719-b092-ef2fe8587383 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:19.472683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4db26-2817-48a1-9999-1974c9a95718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:19.473358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4db26-2817-48a1-9999-1974c9a95718 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.473650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4db26-2817-48a1-9999-1974c9a95718 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.473928 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4db26-2817-48a1-9999-1974c9a95718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.514995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64213d1-6c68-4e7b-a0c0-4d93b0624e7b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:19.536857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4db26-2817-48a1-9999-1974c9a95718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:19.538348 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4db26-2817-48a1-9999-1974c9a95718 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:19.546503 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c3e56-60a2-4782-8340-aea0ef875779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:19.547294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c3e56-60a2-4782-8340-aea0ef875779 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.547591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c3e56-60a2-4782-8340-aea0ef875779 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.547870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c3e56-60a2-4782-8340-aea0ef875779 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.549087 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c3e56-60a2-4782-8340-aea0ef875779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:19.550528 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c3e56-60a2-4782-8340-aea0ef875779 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:19.552300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 42/81] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:19.552901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c3e56-60a2-4782-8340-aea0ef875779 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:19.631517 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 40/82] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:19.632279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4db26-2817-48a1-9999-1974c9a95718 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:19.652582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c3e56-60a2-4782-8340-aea0ef875779 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:19.684751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73209cf-0a9e-4ae8-9de6-e1cfac9d41d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:19.685441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73209cf-0a9e-4ae8-9de6-e1cfac9d41d3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.685740 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73209cf-0a9e-4ae8-9de6-e1cfac9d41d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.686025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73209cf-0a9e-4ae8-9de6-e1cfac9d41d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.726770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4db26-2817-48a1-9999-1974c9a95718 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:19.749636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73209cf-0a9e-4ae8-9de6-e1cfac9d41d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:19.751103 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73209cf-0a9e-4ae8-9de6-e1cfac9d41d3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:19.759226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523803e-febd-4525-8547-a211b53b677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:19.760116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523803e-febd-4525-8547-a211b53b677b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.760403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523803e-febd-4525-8547-a211b53b677b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.760686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523803e-febd-4525-8547-a211b53b677b None admin] PATH_INFO: `/v3/users/55c387b4a9af4a1d99f620de2f727870` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.761950 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523803e-febd-4525-8547-a211b53b677b None admin] RBAC: Authorizing `identity:get_user(user_id=55c387b4a9af4a1d99f620de2f727870)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:19.763390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523803e-febd-4525-8547-a211b53b677b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:19.765069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 41/83] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:19 2022] GET /identity/v3/users/55c387b4a9af4a1d99f620de2f727870 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:19.765834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523803e-febd-4525-8547-a211b53b677b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:19.860754 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 43/84] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:19.861852 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73209cf-0a9e-4ae8-9de6-e1cfac9d41d3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:19.862737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523803e-febd-4525-8547-a211b53b677b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:19.907512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155551a8-2663-45d4-994b-75fe41c16e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:19.908149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155551a8-2663-45d4-994b-75fe41c16e8f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:19.908439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155551a8-2663-45d4-994b-75fe41c16e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:19.908720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155551a8-2663-45d4-994b-75fe41c16e8f None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:19.909505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155551a8-2663-45d4-994b-75fe41c16e8f None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:19.909820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155551a8-2663-45d4-994b-75fe41c16e8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:19.911206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155551a8-2663-45d4-994b-75fe41c16e8f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:19.919915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 42/85] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:19.920833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155551a8-2663-45d4-994b-75fe41c16e8f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:19.981853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73209cf-0a9e-4ae8-9de6-e1cfac9d41d3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:20.015492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68ffe7-45e8-47d4-b71f-0fcc815b02d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:20.016166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68ffe7-45e8-47d4-b71f-0fcc815b02d1 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:20.016454 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68ffe7-45e8-47d4-b71f-0fcc815b02d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:20.016732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68ffe7-45e8-47d4-b71f-0fcc815b02d1 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:20.017478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68ffe7-45e8-47d4-b71f-0fcc815b02d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:20.018925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68ffe7-45e8-47d4-b71f-0fcc815b02d1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:20.020722 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155551a8-2663-45d4-994b-75fe41c16e8f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:20.054709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020dca6-c332-4359-9eea-c732a95d15a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:20.056069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020dca6-c332-4359-9eea-c732a95d15a0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:20.056069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020dca6-c332-4359-9eea-c732a95d15a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:20.056289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020dca6-c332-4359-9eea-c732a95d15a0 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:20.057573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020dca6-c332-4359-9eea-c732a95d15a0 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:20.058974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020dca6-c332-4359-9eea-c732a95d15a0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:20.065691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 43/86] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:19 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:20.065691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020dca6-c332-4359-9eea-c732a95d15a0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:20.109656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 44/87] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:05:19 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:20.110493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68ffe7-45e8-47d4-b71f-0fcc815b02d1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:20.175312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020dca6-c332-4359-9eea-c732a95d15a0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:20.214868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a989de-e9d8-47fb-ac6d-1479866dce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:20.215535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a989de-e9d8-47fb-ac6d-1479866dce77 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:20.215824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a989de-e9d8-47fb-ac6d-1479866dce77 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:20.215918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68ffe7-45e8-47d4-b71f-0fcc815b02d1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:20.216104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a989de-e9d8-47fb-ac6d-1479866dce77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:20.254258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dd1a6-fb41-45fb-9fb1-d452b33ba512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:20.255148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dd1a6-fb41-45fb-9fb1-d452b33ba512 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:20.255423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dd1a6-fb41-45fb-9fb1-d452b33ba512 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:20.255702 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dd1a6-fb41-45fb-9fb1-d452b33ba512 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:20.257134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dd1a6-fb41-45fb-9fb1-d452b33ba512 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:20.258657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dd1a6-fb41-45fb-9fb1-d452b33ba512 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:20.260418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 45/88] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:20 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:20.261268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dd1a6-fb41-45fb-9fb1-d452b33ba512 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:20.324603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a989de-e9d8-47fb-ac6d-1479866dce77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:20.326722 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a989de-e9d8-47fb-ac6d-1479866dce77 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:20.383795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dd1a6-fb41-45fb-9fb1-d452b33ba512 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:20.430138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27e1aa-09d6-4a66-816f-909fbe6f296c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:20.430957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27e1aa-09d6-4a66-816f-909fbe6f296c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:20.431245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27e1aa-09d6-4a66-816f-909fbe6f296c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:20.431526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27e1aa-09d6-4a66-816f-909fbe6f296c None admin] PATH_INFO: `/v3/users/55c387b4a9af4a1d99f620de2f727870` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:20.432773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27e1aa-09d6-4a66-816f-909fbe6f296c None admin] RBAC: Authorizing `identity:get_user(user_id=55c387b4a9af4a1d99f620de2f727870)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:20.434415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27e1aa-09d6-4a66-816f-909fbe6f296c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:20.436088 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 46/89] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:20 2022] GET /identity/v3/users/55c387b4a9af4a1d99f620de2f727870 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:20.436941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27e1aa-09d6-4a66-816f-909fbe6f296c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:20.441500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 44/90] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:20.443021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a989de-e9d8-47fb-ac6d-1479866dce77 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:20.558635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27e1aa-09d6-4a66-816f-909fbe6f296c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:20.563271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a989de-e9d8-47fb-ac6d-1479866dce77 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:20.603525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19129e5-49fe-413e-9dd1-8bcfb224ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:20.604362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19129e5-49fe-413e-9dd1-8bcfb224ca1a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:20.604984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19129e5-49fe-413e-9dd1-8bcfb224ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:20.605536 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19129e5-49fe-413e-9dd1-8bcfb224ca1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:20.606597 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19129e5-49fe-413e-9dd1-8bcfb224ca1a None admin] RBAC: Adding query filter params (role.id=a0c62419d02f426ea41c7faf22b2bf8a, scope.project.id=658d1c3291ff49e386ba21e2afa82144, user.id=55c387b4a9af4a1d99f620de2f727870) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:20.607018 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19129e5-49fe-413e-9dd1-8bcfb224ca1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:20.608858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19129e5-49fe-413e-9dd1-8bcfb224ca1a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:20.609183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775420e-c57c-4d7f-ac9d-021711665996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:20.609846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775420e-c57c-4d7f-ac9d-021711665996 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:20.610131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775420e-c57c-4d7f-ac9d-021711665996 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:20.610410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775420e-c57c-4d7f-ac9d-021711665996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:20.611444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775420e-c57c-4d7f-ac9d-021711665996 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=658d1c3291ff49e386ba21e2afa82144, user.id=3d01d472ac8c4c32a41f169c9057727c) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:20.612193 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775420e-c57c-4d7f-ac9d-021711665996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:20.613901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775420e-c57c-4d7f-ac9d-021711665996 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:20.614889 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 47/91] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:20 2022] GET /identity/v3/role_assignments?user.id=55c387b4a9af4a1d99f620de2f727870&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:20.615944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19129e5-49fe-413e-9dd1-8bcfb224ca1a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:20.621415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 45/92] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:20 2022] GET /identity/v3/role_assignments?user.id=3d01d472ac8c4c32a41f169c9057727c&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:20.622451 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775420e-c57c-4d7f-ac9d-021711665996 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:20.792735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19129e5-49fe-413e-9dd1-8bcfb224ca1a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:20.820376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775420e-c57c-4d7f-ac9d-021711665996 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:20.850738 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57766c81-2fd9-4d3b-a081-d667794d11f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:20.852034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57766c81-2fd9-4d3b-a081-d667794d11f0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:20.852462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57766c81-2fd9-4d3b-a081-d667794d11f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:20.852717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57766c81-2fd9-4d3b-a081-d667794d11f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:20.915975 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f08ad1-ca1f-4f75-933b-117abf65910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:20.916870 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08ad1-ca1f-4f75-933b-117abf65910d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:20.917181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08ad1-ca1f-4f75-933b-117abf65910d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:20.917462 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08ad1-ca1f-4f75-933b-117abf65910d None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:20.918847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f08ad1-ca1f-4f75-933b-117abf65910d None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:20.921050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f08ad1-ca1f-4f75-933b-117abf65910d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:20.929859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 46/93] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:20 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:20.932477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f08ad1-ca1f-4f75-933b-117abf65910d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:20.992391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57766c81-2fd9-4d3b-a081-d667794d11f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:20.993898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57766c81-2fd9-4d3b-a081-d667794d11f0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:21.076102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f08ad1-ca1f-4f75-933b-117abf65910d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:21.128095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 48/94] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:21.133778 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57766c81-2fd9-4d3b-a081-d667794d11f0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:21.170248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ec90f-50f0-443d-b0a9-244d5e48941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:21.171290 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ec90f-50f0-443d-b0a9-244d5e48941b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:21.171799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ec90f-50f0-443d-b0a9-244d5e48941b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:21.172289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ec90f-50f0-443d-b0a9-244d5e48941b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:21.173356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ec90f-50f0-443d-b0a9-244d5e48941b None admin] RBAC: Adding query filter params (role.id=b227940c19244df2b57662537283a467, scope.project.id=658d1c3291ff49e386ba21e2afa82144, user.id=55c387b4a9af4a1d99f620de2f727870) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:21.173880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ec90f-50f0-443d-b0a9-244d5e48941b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:21.175525 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ec90f-50f0-443d-b0a9-244d5e48941b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:21.194954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 47/95] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:20 2022] GET /identity/v3/role_assignments?user.id=55c387b4a9af4a1d99f620de2f727870&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=b227940c19244df2b57662537283a467 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:21.313935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57766c81-2fd9-4d3b-a081-d667794d11f0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:21.366082 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2afbb-ea7d-415d-b807-559c14b9dbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:21.366866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2afbb-ea7d-415d-b807-559c14b9dbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:21.367359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2afbb-ea7d-415d-b807-559c14b9dbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:21.367645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2afbb-ea7d-415d-b807-559c14b9dbd4 None admin] PATH_INFO: `/v3/projects/5421d9b6782c4ff78dba61b1112c633d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:21.368859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2afbb-ea7d-415d-b807-559c14b9dbd4 None admin] RBAC: Authorizing `identity:get_project(project_id=5421d9b6782c4ff78dba61b1112c633d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:21.370380 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2afbb-ea7d-415d-b807-559c14b9dbd4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:21.372418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 49/96] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:21 2022] GET /identity/v3/projects/5421d9b6782c4ff78dba61b1112c633d => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:21.378233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ec90f-50f0-443d-b0a9-244d5e48941b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:21.494724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ec90f-50f0-443d-b0a9-244d5e48941b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:21.532497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8760e-ee21-4716-838a-efb3cadb33f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:21.533203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8760e-ee21-4716-838a-efb3cadb33f8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:21.533494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8760e-ee21-4716-838a-efb3cadb33f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:21.533775 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8760e-ee21-4716-838a-efb3cadb33f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:21.534630 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8760e-ee21-4716-838a-efb3cadb33f8 None admin] RBAC: Adding query filter params (role.id=a0c62419d02f426ea41c7faf22b2bf8a, scope.project.id=5421d9b6782c4ff78dba61b1112c633d, user.id=55c387b4a9af4a1d99f620de2f727870) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:21.534939 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8760e-ee21-4716-838a-efb3cadb33f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:21.536389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8760e-ee21-4716-838a-efb3cadb33f8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:21.545643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 48/97] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:21 2022] GET /identity/v3/role_assignments?user.id=55c387b4a9af4a1d99f620de2f727870&scope.project.id=5421d9b6782c4ff78dba61b1112c633d&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:23.076278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28166c28-b637-4310-ab6e-82f1d3830d2f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:23.076768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28166c28-b637-4310-ab6e-82f1d3830d2f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:23.076768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28166c28-b637-4310-ab6e-82f1d3830d2f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:23.078152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 50/98] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:23.083416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95567cd-f526-438c-98f0-9e571495c6fd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:23.083829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95567cd-f526-438c-98f0-9e571495c6fd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:23.083999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95567cd-f526-438c-98f0-9e571495c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:23.110206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e95567cd-f526-438c-98f0-9e571495c6fd None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:23.111494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e95567cd-f526-438c-98f0-9e571495c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:23.199639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 49/99] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:23.223633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28166c28-b637-4310-ab6e-82f1d3830d2f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:23.329860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28166c28-b637-4310-ab6e-82f1d3830d2f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:23.365251 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366d540-b588-4b2a-bc13-6889e65d7e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:23.366058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366d540-b588-4b2a-bc13-6889e65d7e92 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:23.366341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366d540-b588-4b2a-bc13-6889e65d7e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:23.366616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366d540-b588-4b2a-bc13-6889e65d7e92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:23.377474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366d540-b588-4b2a-bc13-6889e65d7e92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:23.385669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-7366d540-b588-4b2a-bc13-6889e65d7e92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 14:05:23.387177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 51/100] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:23.392777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95567cd-f526-438c-98f0-9e571495c6fd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:23.515105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95567cd-f526-438c-98f0-9e571495c6fd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:23.561483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357263e-908f-4ecf-8be4-49d7b3f57f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:23.562168 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357263e-908f-4ecf-8be4-49d7b3f57f26 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:23.562456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357263e-908f-4ecf-8be4-49d7b3f57f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:23.562778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357263e-908f-4ecf-8be4-49d7b3f57f26 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:23.563532 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357263e-908f-4ecf-8be4-49d7b3f57f26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:23.563847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357263e-908f-4ecf-8be4-49d7b3f57f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:23.565347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357263e-908f-4ecf-8be4-49d7b3f57f26 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:23.577098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 50/101] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:23.582521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366d540-b588-4b2a-bc13-6889e65d7e92 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:23.684177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366d540-b588-4b2a-bc13-6889e65d7e92 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:23.719633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411df9d6-8157-4b63-8ae4-2299ade4afc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:23.720513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df9d6-8157-4b63-8ae4-2299ade4afc7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:23.720798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df9d6-8157-4b63-8ae4-2299ade4afc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:23.721106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df9d6-8157-4b63-8ae4-2299ade4afc7 None admin] PATH_INFO: `/v3/users/9d7e37a916364b6c86f9d3b17437aa74` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:23.735121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411df9d6-8157-4b63-8ae4-2299ade4afc7 None admin] RBAC: Authorizing `identity:get_user(user_id=9d7e37a916364b6c86f9d3b17437aa74)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:23.736641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411df9d6-8157-4b63-8ae4-2299ade4afc7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:23.738489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 52/102] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:23 2022] GET /identity/v3/users/9d7e37a916364b6c86f9d3b17437aa74 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:23.744195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357263e-908f-4ecf-8be4-49d7b3f57f26 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:23.857389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357263e-908f-4ecf-8be4-49d7b3f57f26 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:23.891725 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122c369-3573-481d-8b1f-b17785902069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:23.892384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122c369-3573-481d-8b1f-b17785902069 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:23.892673 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122c369-3573-481d-8b1f-b17785902069 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:23.893013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122c369-3573-481d-8b1f-b17785902069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:23.910413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e13f9b-57bd-41bf-b39b-362a7f04b453 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:23.911014 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e13f9b-57bd-41bf-b39b-362a7f04b453 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:23.911504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e13f9b-57bd-41bf-b39b-362a7f04b453 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:23.913109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 53/103] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:23.918992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946b8b0-ada6-472c-bee8-379a42598484 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:23.919542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946b8b0-ada6-472c-bee8-379a42598484 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:23.920018 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946b8b0-ada6-472c-bee8-379a42598484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:23.937571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a946b8b0-ada6-472c-bee8-379a42598484 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:23.939091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a946b8b0-ada6-472c-bee8-379a42598484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:23.984412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122c369-3573-481d-8b1f-b17785902069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:23.986683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122c369-3573-481d-8b1f-b17785902069 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:24.069516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 54/104] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:24.072894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c2edf-0fb7-49eb-a259-6013fd2c467b None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:24.074340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c2edf-0fb7-49eb-a259-6013fd2c467b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:24.077405 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c2edf-0fb7-49eb-a259-6013fd2c467b None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:24.079373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 55/105] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:24.084828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c0f98-5359-4d63-9423-6dbe3a26c804 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:24.085322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c0f98-5359-4d63-9423-6dbe3a26c804 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:24.085922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c0f98-5359-4d63-9423-6dbe3a26c804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:24.122151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-216c0f98-5359-4d63-9423-6dbe3a26c804 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:24.123673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-216c0f98-5359-4d63-9423-6dbe3a26c804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:24.174370 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 51/106] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:24.175894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122c369-3573-481d-8b1f-b17785902069 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:24.256794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 56/107] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:24.257844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c0f98-5359-4d63-9423-6dbe3a26c804 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:24.300400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122c369-3573-481d-8b1f-b17785902069 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:24.336392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab320b3-a9fe-49c8-ac58-450ffcf1a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:24.337521 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab320b3-a9fe-49c8-ac58-450ffcf1a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:24.338002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab320b3-a9fe-49c8-ac58-450ffcf1a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:24.338460 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab320b3-a9fe-49c8-ac58-450ffcf1a1a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:24.349337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab320b3-a9fe-49c8-ac58-450ffcf1a1a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:24.357074 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-2ab320b3-a9fe-49c8-ac58-450ffcf1a1a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:05:24.358499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 52/108] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:05:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:24.359981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944e6f-b8a4-4b38-b4d3-12cb58b7ee1d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:24.360447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944e6f-b8a4-4b38-b4d3-12cb58b7ee1d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:24.360909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944e6f-b8a4-4b38-b4d3-12cb58b7ee1d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:24.362402 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 53/109] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:24.363271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55944e6f-b8a4-4b38-b4d3-12cb58b7ee1d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:24.402902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c0f98-5359-4d63-9423-6dbe3a26c804 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:24.447543 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94754a30-6c2c-40bc-b21f-4ccd52b0d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:24.449356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94754a30-6c2c-40bc-b21f-4ccd52b0d9fd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:24.449956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94754a30-6c2c-40bc-b21f-4ccd52b0d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:24.450513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94754a30-6c2c-40bc-b21f-4ccd52b0d9fd None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:24.452094 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94754a30-6c2c-40bc-b21f-4ccd52b0d9fd None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:24.454436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94754a30-6c2c-40bc-b21f-4ccd52b0d9fd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:24.456827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 57/110] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:24 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:24.457783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94754a30-6c2c-40bc-b21f-4ccd52b0d9fd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:24.478411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55944e6f-b8a4-4b38-b4d3-12cb58b7ee1d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:24.521803 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969515ca-5595-45e2-9950-1e6a1db3ad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:24.522614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969515ca-5595-45e2-9950-1e6a1db3ad4c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:24.522899 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969515ca-5595-45e2-9950-1e6a1db3ad4c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:24.523747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969515ca-5595-45e2-9950-1e6a1db3ad4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:24.540933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969515ca-5595-45e2-9950-1e6a1db3ad4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:24.547956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-969515ca-5595-45e2-9950-1e6a1db3ad4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:24.549458 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 54/111] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:24.554350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe806b-9e62-44de-b750-c6749756618a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:24.554747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe806b-9e62-44de-b750-c6749756618a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:24.555041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe806b-9e62-44de-b750-c6749756618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:24.574793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-91fe806b-9e62-44de-b750-c6749756618a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:24.575970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-91fe806b-9e62-44de-b750-c6749756618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:24.589864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94754a30-6c2c-40bc-b21f-4ccd52b0d9fd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:24.635923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540009e-b899-4dff-a512-3cc29d2f5cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:24.636892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540009e-b899-4dff-a512-3cc29d2f5cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:24.637357 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540009e-b899-4dff-a512-3cc29d2f5cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:24.637647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540009e-b899-4dff-a512-3cc29d2f5cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:24.638425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540009e-b899-4dff-a512-3cc29d2f5cd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:24.638741 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540009e-b899-4dff-a512-3cc29d2f5cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:24.640257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540009e-b899-4dff-a512-3cc29d2f5cd9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:24.649682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 58/112] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:24.650645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540009e-b899-4dff-a512-3cc29d2f5cd9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:24.657500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 55/113] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:24.658620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe806b-9e62-44de-b750-c6749756618a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:24.768900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540009e-b899-4dff-a512-3cc29d2f5cd9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:24.780462 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe806b-9e62-44de-b750-c6749756618a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:24.807247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c456-a64e-45bf-9436-707125e3bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:24.815879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c456-a64e-45bf-9436-707125e3bc22 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:24.815879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c456-a64e-45bf-9436-707125e3bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:24.815879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c456-a64e-45bf-9436-707125e3bc22 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:24.816105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a9d1b-b854-4df0-88e2-e372240b274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:24.816215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c456-a64e-45bf-9436-707125e3bc22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:24.816285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9d1b-b854-4df0-88e2-e372240b274a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:24.816349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c456-a64e-45bf-9436-707125e3bc22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:24.816446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9d1b-b854-4df0-88e2-e372240b274a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:24.816446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9d1b-b854-4df0-88e2-e372240b274a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:24.816446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a9d1b-b854-4df0-88e2-e372240b274a None admin] RBAC: Adding query filter params (role.id=a0d8f7cc5da940d1a33a8d08b79f833b, scope.project.id=658d1c3291ff49e386ba21e2afa82144, user.id=9d7e37a916364b6c86f9d3b17437aa74) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:24.816638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c456-a64e-45bf-9436-707125e3bc22 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:24.816704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a9d1b-b854-4df0-88e2-e372240b274a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:24.816704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a9d1b-b854-4df0-88e2-e372240b274a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:24.829264 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 59/114] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:24 2022] GET /identity/v3/role_assignments?user.id=9d7e37a916364b6c86f9d3b17437aa74&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=a0d8f7cc5da940d1a33a8d08b79f833b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:24.829264 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a9d1b-b854-4df0-88e2-e372240b274a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:24.833916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 56/115] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:24.836135 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a5e8-a249-4885-a654-c5b6ba33a2a1 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:24.836719 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a5e8-a249-4885-a654-c5b6ba33a2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:24.837328 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a5e8-a249-4885-a654-c5b6ba33a2a1 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:24.839266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 57/116] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:24.844416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178a5e8-a249-4885-a654-c5b6ba33a2a1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:24.954520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a9d1b-b854-4df0-88e2-e372240b274a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:24.968762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178a5e8-a249-4885-a654-c5b6ba33a2a1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:25.000580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369dc159-3255-4942-857e-c3d646bc6b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:25.001708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dc159-3255-4942-857e-c3d646bc6b9a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.002324 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dc159-3255-4942-857e-c3d646bc6b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.002758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dc159-3255-4942-857e-c3d646bc6b9a None admin] PATH_INFO: `/v3/users/3d01d472ac8c4c32a41f169c9057727c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.004254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369dc159-3255-4942-857e-c3d646bc6b9a None admin] RBAC: Authorizing `identity:get_user(user_id=3d01d472ac8c4c32a41f169c9057727c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:25.006004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369dc159-3255-4942-857e-c3d646bc6b9a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:25.007347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9488a94-0f17-4191-b768-3eb3ce98e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:25.008059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 60/117] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:24 2022] GET /identity/v3/users/3d01d472ac8c4c32a41f169c9057727c => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:25.008558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9488a94-0f17-4191-b768-3eb3ce98e324 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.008854 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369dc159-3255-4942-857e-c3d646bc6b9a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:25.009012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9488a94-0f17-4191-b768-3eb3ce98e324 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.009363 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9488a94-0f17-4191-b768-3eb3ce98e324 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.010825 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9488a94-0f17-4191-b768-3eb3ce98e324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:25.013471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9488a94-0f17-4191-b768-3eb3ce98e324 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:25.014672 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 58/118] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:25.015945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a27bae-a82e-4d50-96e8-1def015eaf78 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.016336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a27bae-a82e-4d50-96e8-1def015eaf78 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.016679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a27bae-a82e-4d50-96e8-1def015eaf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.034739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-95a27bae-a82e-4d50-96e8-1def015eaf78 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:25.035949 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-95a27bae-a82e-4d50-96e8-1def015eaf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:25.116171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 59/119] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:25.117106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a27bae-a82e-4d50-96e8-1def015eaf78 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:25.123815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369dc159-3255-4942-857e-c3d646bc6b9a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:25.158320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88b70b-5009-475a-ae44-4c58ca08d678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:25.159531 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b70b-5009-475a-ae44-4c58ca08d678 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.160066 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b70b-5009-475a-ae44-4c58ca08d678 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.160554 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b70b-5009-475a-ae44-4c58ca08d678 None admin] PATH_INFO: `/v3/users/55c387b4a9af4a1d99f620de2f727870` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.162026 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88b70b-5009-475a-ae44-4c58ca08d678 None admin] RBAC: Authorizing `identity:get_user(user_id=55c387b4a9af4a1d99f620de2f727870)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:25.164358 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88b70b-5009-475a-ae44-4c58ca08d678 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:25.166322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 61/120] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:25 2022] GET /identity/v3/users/55c387b4a9af4a1d99f620de2f727870 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:25.167253 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88b70b-5009-475a-ae44-4c58ca08d678 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:25.219199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a27bae-a82e-4d50-96e8-1def015eaf78 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:25.254763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377dc5f-40bf-4f58-9b0e-5815b61157a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:25.255632 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377dc5f-40bf-4f58-9b0e-5815b61157a4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.255917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377dc5f-40bf-4f58-9b0e-5815b61157a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.256195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377dc5f-40bf-4f58-9b0e-5815b61157a4 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.257423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377dc5f-40bf-4f58-9b0e-5815b61157a4 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:25.259236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377dc5f-40bf-4f58-9b0e-5815b61157a4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:25.260939 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 60/121] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:25 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:25.262572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377dc5f-40bf-4f58-9b0e-5815b61157a4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:25.272572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88b70b-5009-475a-ae44-4c58ca08d678 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:25.307437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134df0d8-243c-4608-af30-99f13e5ed8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:25.308129 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df0d8-243c-4608-af30-99f13e5ed8f5 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.308419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df0d8-243c-4608-af30-99f13e5ed8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.308701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df0d8-243c-4608-af30-99f13e5ed8f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.309443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134df0d8-243c-4608-af30-99f13e5ed8f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:25.310900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134df0d8-243c-4608-af30-99f13e5ed8f5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:25.362201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377dc5f-40bf-4f58-9b0e-5815b61157a4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:25.394707 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0446b4-ed33-467c-98cd-c36e2860e125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:25.395563 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0446b4-ed33-467c-98cd-c36e2860e125 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.395880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0446b4-ed33-467c-98cd-c36e2860e125 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.396151 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0446b4-ed33-467c-98cd-c36e2860e125 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.396247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 62/122] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:05:25 2022] POST /identity/v3/projects => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:25.401129 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134df0d8-243c-4608-af30-99f13e5ed8f5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:25.408356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0446b4-ed33-467c-98cd-c36e2860e125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:25.416909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-8f0446b4-ed33-467c-98cd-c36e2860e125 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:05:25.418515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 61/123] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:05:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:25.419751 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccbbf3-0b81-442f-a0e4-f3c9f2d7874e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.420110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccbbf3-0b81-442f-a0e4-f3c9f2d7874e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.420462 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccbbf3-0b81-442f-a0e4-f3c9f2d7874e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.422242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 62/124] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:25.423015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccbbf3-0b81-442f-a0e4-f3c9f2d7874e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:25.536220 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134df0d8-243c-4608-af30-99f13e5ed8f5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:25.555323 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccbbf3-0b81-442f-a0e4-f3c9f2d7874e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:25.582220 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b677dc-abe1-4748-ab83-825f7f422be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:25.584222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b677dc-abe1-4748-ab83-825f7f422be3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.584222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b677dc-abe1-4748-ab83-825f7f422be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.584222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b677dc-abe1-4748-ab83-825f7f422be3 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.585927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b677dc-abe1-4748-ab83-825f7f422be3 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:25.587445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b677dc-abe1-4748-ab83-825f7f422be3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:25.589390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 63/125] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:25 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:25.590001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b677dc-abe1-4748-ab83-825f7f422be3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:25.605314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80169a7b-6a23-45ae-b741-2260b3a4e061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:25.606560 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80169a7b-6a23-45ae-b741-2260b3a4e061 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.606849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80169a7b-6a23-45ae-b741-2260b3a4e061 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.607131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80169a7b-6a23-45ae-b741-2260b3a4e061 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144/users/3d01d472ac8c4c32a41f169c9057727c/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.610005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80169a7b-6a23-45ae-b741-2260b3a4e061 None admin] RBAC: Authorizing `identity:create_grant(project_id=658d1c3291ff49e386ba21e2afa82144, user_id=3d01d472ac8c4c32a41f169c9057727c, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:25.611461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80169a7b-6a23-45ae-b741-2260b3a4e061 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:25.692793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 63/126] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:05:25 2022] PUT /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144/users/3d01d472ac8c4c32a41f169c9057727c/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:05:25.694183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b677dc-abe1-4748-ab83-825f7f422be3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:25.694563 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1c71d-80eb-406e-a5cd-22b21774d945 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.695048 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1c71d-80eb-406e-a5cd-22b21774d945 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.695337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1c71d-80eb-406e-a5cd-22b21774d945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.736610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6be1c71d-80eb-406e-a5cd-22b21774d945 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:25.743356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6be1c71d-80eb-406e-a5cd-22b21774d945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:25.782807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05f87-7d57-4971-9a09-f64ddfed8c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:25.783501 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05f87-7d57-4971-9a09-f64ddfed8c8b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.783786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05f87-7d57-4971-9a09-f64ddfed8c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.784122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05f87-7d57-4971-9a09-f64ddfed8c8b None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.787745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b05f87-7d57-4971-9a09-f64ddfed8c8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:25.788208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b05f87-7d57-4971-9a09-f64ddfed8c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:25.791643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b05f87-7d57-4971-9a09-f64ddfed8c8b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:25.811859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 64/127] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:05:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:25.812504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05f87-7d57-4971-9a09-f64ddfed8c8b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:25.899340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 64/128] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:25.900263 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1c71d-80eb-406e-a5cd-22b21774d945 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:25.953413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05f87-7d57-4971-9a09-f64ddfed8c8b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:25.989618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d0afb-19f4-49d4-ac19-36ba24341678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:25.990525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d0afb-19f4-49d4-ac19-36ba24341678 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:25.990816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d0afb-19f4-49d4-ac19-36ba24341678 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:25.991099 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d0afb-19f4-49d4-ac19-36ba24341678 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144/users/55c387b4a9af4a1d99f620de2f727870/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:25.994012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d0afb-19f4-49d4-ac19-36ba24341678 None admin] RBAC: Authorizing `identity:create_grant(project_id=658d1c3291ff49e386ba21e2afa82144, user_id=55c387b4a9af4a1d99f620de2f727870, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:25.995644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d0afb-19f4-49d4-ac19-36ba24341678 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:26.025771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1c71d-80eb-406e-a5cd-22b21774d945 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:26.065212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0da9b-fff6-4905-be3c-36c27b90fd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:26.065212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0da9b-fff6-4905-be3c-36c27b90fd29 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:26.065212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0da9b-fff6-4905-be3c-36c27b90fd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:26.065212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0da9b-fff6-4905-be3c-36c27b90fd29 None admin] PATH_INFO: `/v3/users/55c387b4a9af4a1d99f620de2f727870` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:26.065581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0da9b-fff6-4905-be3c-36c27b90fd29 None admin] RBAC: Authorizing `identity:get_user(user_id=55c387b4a9af4a1d99f620de2f727870)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:26.065581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0da9b-fff6-4905-be3c-36c27b90fd29 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:26.067054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 65/129] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:25 2022] GET /identity/v3/users/55c387b4a9af4a1d99f620de2f727870 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:26.067819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0da9b-fff6-4905-be3c-36c27b90fd29 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:26.122525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 65/130] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:05:25 2022] PUT /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144/users/55c387b4a9af4a1d99f620de2f727870/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:05:26.123391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d0afb-19f4-49d4-ac19-36ba24341678 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:26.198638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0da9b-fff6-4905-be3c-36c27b90fd29 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:26.239827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e5732-5602-4ba6-89f5-f9def4eef4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:26.240714 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5732-5602-4ba6-89f5-f9def4eef4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:26.241029 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5732-5602-4ba6-89f5-f9def4eef4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:26.241313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5732-5602-4ba6-89f5-f9def4eef4f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:26.254394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e5732-5602-4ba6-89f5-f9def4eef4f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:26.263566 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-ff9e5732-5602-4ba6-89f5-f9def4eef4f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:26.265364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 66/131] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:26.271872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e5732-5602-4ba6-89f5-f9def4eef4f2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:26.283491 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d0afb-19f4-49d4-ac19-36ba24341678 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:26.344876 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bda49e-1bcd-4ef6-8789-e4d9b9cdac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:26.345756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bda49e-1bcd-4ef6-8789-e4d9b9cdac77 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:26.346117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bda49e-1bcd-4ef6-8789-e4d9b9cdac77 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:26.346473 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bda49e-1bcd-4ef6-8789-e4d9b9cdac77 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:26.347697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bda49e-1bcd-4ef6-8789-e4d9b9cdac77 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:26.349254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bda49e-1bcd-4ef6-8789-e4d9b9cdac77 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:26.351285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 66/132] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:26 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:26.360391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bda49e-1bcd-4ef6-8789-e4d9b9cdac77 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:26.475453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bda49e-1bcd-4ef6-8789-e4d9b9cdac77 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:26.511110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e5732-5602-4ba6-89f5-f9def4eef4f2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:26.514417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9d6a7-ec5d-4e27-8fbf-dc922bcd6844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:26.516077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9d6a7-ec5d-4e27-8fbf-dc922bcd6844 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:26.516396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9d6a7-ec5d-4e27-8fbf-dc922bcd6844 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:26.516682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9d6a7-ec5d-4e27-8fbf-dc922bcd6844 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144/users/55c387b4a9af4a1d99f620de2f727870/roles/b227940c19244df2b57662537283a467` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:26.518980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9d6a7-ec5d-4e27-8fbf-dc922bcd6844 None admin] RBAC: Authorizing `identity:create_grant(project_id=658d1c3291ff49e386ba21e2afa82144, user_id=55c387b4a9af4a1d99f620de2f727870, role_id=b227940c19244df2b57662537283a467)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:26.520459 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9d6a7-ec5d-4e27-8fbf-dc922bcd6844 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:26.556375 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac338ae-61f6-448d-abf1-7a9a2a4d3bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:26.557086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac338ae-61f6-448d-abf1-7a9a2a4d3bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:26.557381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac338ae-61f6-448d-abf1-7a9a2a4d3bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:26.557661 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac338ae-61f6-448d-abf1-7a9a2a4d3bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:26.558418 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac338ae-61f6-448d-abf1-7a9a2a4d3bf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:26.558734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac338ae-61f6-448d-abf1-7a9a2a4d3bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:26.560136 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac338ae-61f6-448d-abf1-7a9a2a4d3bf5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:26.572042 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 67/133] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:26.579157 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac338ae-61f6-448d-abf1-7a9a2a4d3bf5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:26.607865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 67/134] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:05:26 2022] PUT /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144/users/55c387b4a9af4a1d99f620de2f727870/roles/b227940c19244df2b57662537283a467 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:05:26.702409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac338ae-61f6-448d-abf1-7a9a2a4d3bf5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:26.739895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3c748-b738-4383-a65e-5393777d6c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:26.740812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3c748-b738-4383-a65e-5393777d6c49 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:26.741133 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3c748-b738-4383-a65e-5393777d6c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:26.741412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3c748-b738-4383-a65e-5393777d6c49 None admin] PATH_INFO: `/v3/users/55c387b4a9af4a1d99f620de2f727870` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:26.742825 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3c748-b738-4383-a65e-5393777d6c49 None admin] RBAC: Authorizing `identity:get_user(user_id=55c387b4a9af4a1d99f620de2f727870)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:26.744323 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3c748-b738-4383-a65e-5393777d6c49 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:26.746335 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 68/135] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:26 2022] GET /identity/v3/users/55c387b4a9af4a1d99f620de2f727870 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:26.751941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9d6a7-ec5d-4e27-8fbf-dc922bcd6844 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:26.876029 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9d6a7-ec5d-4e27-8fbf-dc922bcd6844 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:26.915426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0daa91-b33e-487d-ad1f-81b3bf0d9bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:26.916655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0daa91-b33e-487d-ad1f-81b3bf0d9bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:26.917273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0daa91-b33e-487d-ad1f-81b3bf0d9bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:26.917762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0daa91-b33e-487d-ad1f-81b3bf0d9bf8 None admin] PATH_INFO: `/v3/projects/5421d9b6782c4ff78dba61b1112c633d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:26.919272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0daa91-b33e-487d-ad1f-81b3bf0d9bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=5421d9b6782c4ff78dba61b1112c633d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:26.920950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0daa91-b33e-487d-ad1f-81b3bf0d9bf8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:26.922893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 68/136] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:26 2022] GET /identity/v3/projects/5421d9b6782c4ff78dba61b1112c633d => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:26.928676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3c748-b738-4383-a65e-5393777d6c49 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:27.047482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3c748-b738-4383-a65e-5393777d6c49 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:27.086984 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdfd70-d51b-4361-ba6b-98ee5fbd4003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:27.087956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdfd70-d51b-4361-ba6b-98ee5fbd4003 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:27.088251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdfd70-d51b-4361-ba6b-98ee5fbd4003 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:27.088535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdfd70-d51b-4361-ba6b-98ee5fbd4003 None admin] PATH_INFO: `/v3/projects/5421d9b6782c4ff78dba61b1112c633d/users/55c387b4a9af4a1d99f620de2f727870/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:27.090629 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdfd70-d51b-4361-ba6b-98ee5fbd4003 None admin] RBAC: Authorizing `identity:create_grant(project_id=5421d9b6782c4ff78dba61b1112c633d, user_id=55c387b4a9af4a1d99f620de2f727870, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:27.092119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdfd70-d51b-4361-ba6b-98ee5fbd4003 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:27.184005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 69/137] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:05:26 2022] PUT /identity/v3/projects/5421d9b6782c4ff78dba61b1112c633d/users/55c387b4a9af4a1d99f620de2f727870/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:05:28.391054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b2eb6-e084-4c5f-872e-ee546a024cc8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:28.391560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b2eb6-e084-4c5f-872e-ee546a024cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:28.391631 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b2eb6-e084-4c5f-872e-ee546a024cc8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:28.393016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 69/138] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:28.398793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633283a-af56-4168-8b95-b9a314a7b007 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:28.399255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633283a-af56-4168-8b95-b9a314a7b007 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:28.399448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633283a-af56-4168-8b95-b9a314a7b007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:28.421107 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2633283a-af56-4168-8b95-b9a314a7b007 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:28.422312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2633283a-af56-4168-8b95-b9a314a7b007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:28.509735 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 70/139] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:28.532898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b2eb6-e084-4c5f-872e-ee546a024cc8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:28.639600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b2eb6-e084-4c5f-872e-ee546a024cc8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:28.675819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804e5a9-9ec0-4fa3-9673-0834bf33c09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:28.676606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804e5a9-9ec0-4fa3-9673-0834bf33c09f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:28.676890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804e5a9-9ec0-4fa3-9673-0834bf33c09f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:28.681003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804e5a9-9ec0-4fa3-9673-0834bf33c09f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:28.688507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804e5a9-9ec0-4fa3-9673-0834bf33c09f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:28.696125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-1804e5a9-9ec0-4fa3-9673-0834bf33c09f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 14:05:28.697370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 70/140] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:28.703698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633283a-af56-4168-8b95-b9a314a7b007 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:28.711516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed804d24-bba4-4405-8be6-d5f6f122b937 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:28.711810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed804d24-bba4-4405-8be6-d5f6f122b937 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:28.712093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed804d24-bba4-4405-8be6-d5f6f122b937 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:28.713754 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 71/141] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:28.718566 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb60186-ae09-4b76-abe5-694573134966 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:28.718856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb60186-ae09-4b76-abe5-694573134966 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:28.719142 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb60186-ae09-4b76-abe5-694573134966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:28.752617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3cb60186-ae09-4b76-abe5-694573134966 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:28.754885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3cb60186-ae09-4b76-abe5-694573134966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:28.887245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 72/142] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:28.894115 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633283a-af56-4168-8b95-b9a314a7b007 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:28.936235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb60186-ae09-4b76-abe5-694573134966 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:28.962589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2ba85-950c-47f6-acba-d2abc53fe34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:28.963677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ba85-950c-47f6-acba-d2abc53fe34f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:28.965438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ba85-950c-47f6-acba-d2abc53fe34f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:28.965920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ba85-950c-47f6-acba-d2abc53fe34f None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:28.966874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2ba85-950c-47f6-acba-d2abc53fe34f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:28.967923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2ba85-950c-47f6-acba-d2abc53fe34f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:28.973246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2ba85-950c-47f6-acba-d2abc53fe34f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:28.987797 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 71/143] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:29.017348 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2ba85-950c-47f6-acba-d2abc53fe34f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:29.107469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb60186-ae09-4b76-abe5-694573134966 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:29.174295 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f2860-0243-4eb5-9d19-8fe5b0206393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:29.175488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f2860-0243-4eb5-9d19-8fe5b0206393 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.175987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f2860-0243-4eb5-9d19-8fe5b0206393 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.176473 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f2860-0243-4eb5-9d19-8fe5b0206393 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.181718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f2860-0243-4eb5-9d19-8fe5b0206393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:29.183552 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f2860-0243-4eb5-9d19-8fe5b0206393 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:29.185535 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 73/144] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:29.191170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f2860-0243-4eb5-9d19-8fe5b0206393 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:29.223681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2ba85-950c-47f6-acba-d2abc53fe34f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:29.283942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c157e-33c4-475b-8d70-165483473630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:29.284751 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c157e-33c4-475b-8d70-165483473630 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.285064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c157e-33c4-475b-8d70-165483473630 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.285367 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c157e-33c4-475b-8d70-165483473630 None admin] PATH_INFO: `/v3/users/9d7e37a916364b6c86f9d3b17437aa74` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.286700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c157e-33c4-475b-8d70-165483473630 None admin] RBAC: Authorizing `identity:get_user(user_id=9d7e37a916364b6c86f9d3b17437aa74)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:29.288176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c157e-33c4-475b-8d70-165483473630 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:29.301111 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 72/145] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:29 2022] GET /identity/v3/users/9d7e37a916364b6c86f9d3b17437aa74 => generated 289 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:29.301111 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeee29-aa23-4484-8bc4-45529cc16867 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.301111 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeee29-aa23-4484-8bc4-45529cc16867 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.301111 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeee29-aa23-4484-8bc4-45529cc16867 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.302964 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 73/146] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:29.307145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b3cb2-a479-442b-be2f-27ab2cfbffdd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.308119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b3cb2-a479-442b-be2f-27ab2cfbffdd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.308119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b3cb2-a479-442b-be2f-27ab2cfbffdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.318764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f2860-0243-4eb5-9d19-8fe5b0206393 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:29.332514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a41b3cb2-a479-442b-be2f-27ab2cfbffdd None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:29.341930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a41b3cb2-a479-442b-be2f-27ab2cfbffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:29.356182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb33a64-040b-4285-8ab9-3e98c4ac3ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:29.357209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb33a64-040b-4285-8ab9-3e98c4ac3ce0 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.357692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb33a64-040b-4285-8ab9-3e98c4ac3ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.358188 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb33a64-040b-4285-8ab9-3e98c4ac3ce0 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.359175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb33a64-040b-4285-8ab9-3e98c4ac3ce0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:29.361025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb33a64-040b-4285-8ab9-3e98c4ac3ce0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:29.419285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 74/147] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:29.421050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b3cb2-a479-442b-be2f-27ab2cfbffdd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:29.442143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 74/148] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:05:29 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:05:29.453800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb33a64-040b-4285-8ab9-3e98c4ac3ce0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:29.599961 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb33a64-040b-4285-8ab9-3e98c4ac3ce0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:29.643228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56a0dd-8d18-4412-adc3-d16b308a7302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:29.645362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56a0dd-8d18-4412-adc3-d16b308a7302 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.645834 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56a0dd-8d18-4412-adc3-d16b308a7302 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.646311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56a0dd-8d18-4412-adc3-d16b308a7302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.650838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b3cb2-a479-442b-be2f-27ab2cfbffdd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:29.677713 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56a0dd-8d18-4412-adc3-d16b308a7302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:29.684925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-7e56a0dd-8d18-4412-adc3-d16b308a7302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:05:29.693794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 75/149] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:29.695414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447b66a-9411-4594-92a1-85d086eb629f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.695673 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee5b61-ea56-435c-9384-a6f7492f906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:29.695794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447b66a-9411-4594-92a1-85d086eb629f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.695980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447b66a-9411-4594-92a1-85d086eb629f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.696618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee5b61-ea56-435c-9384-a6f7492f906b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.696905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee5b61-ea56-435c-9384-a6f7492f906b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.697249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee5b61-ea56-435c-9384-a6f7492f906b None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.697344 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 76/150] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:29.698750 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a23dd5-7866-4b23-9545-d715ea2060fe None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.698928 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee5b61-ea56-435c-9384-a6f7492f906b None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:29.699018 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a23dd5-7866-4b23-9545-d715ea2060fe None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.699306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a23dd5-7866-4b23-9545-d715ea2060fe None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.700412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee5b61-ea56-435c-9384-a6f7492f906b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:29.700578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 77/151] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:29.702789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 75/152] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:29 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:29.705723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a23dd5-7866-4b23-9545-d715ea2060fe None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:29.707745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1482e81-6f43-43ae-a8bf-0cf1f7a479ee None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.708043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1482e81-6f43-43ae-a8bf-0cf1f7a479ee None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.708383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1482e81-6f43-43ae-a8bf-0cf1f7a479ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.729055 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e1482e81-6f43-43ae-a8bf-0cf1f7a479ee None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:29.730250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e1482e81-6f43-43ae-a8bf-0cf1f7a479ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:29.817965 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 76/153] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:29.819102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec365b9-a454-4927-bab1-cbd12a98283f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.819447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec365b9-a454-4927-bab1-cbd12a98283f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.819695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec365b9-a454-4927-bab1-cbd12a98283f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.838047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3ec365b9-a454-4927-bab1-cbd12a98283f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:29.838214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a23dd5-7866-4b23-9545-d715ea2060fe None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:29.839197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ec365b9-a454-4927-bab1-cbd12a98283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:29.884046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f946f7-8905-49cc-b0cd-bc65032a30a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:29.884732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f946f7-8905-49cc-b0cd-bc65032a30a9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:29.885070 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f946f7-8905-49cc-b0cd-bc65032a30a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:29.885451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f946f7-8905-49cc-b0cd-bc65032a30a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:29.886215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f946f7-8905-49cc-b0cd-bc65032a30a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:29.886576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f946f7-8905-49cc-b0cd-bc65032a30a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:29.887977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f946f7-8905-49cc-b0cd-bc65032a30a9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:29.896510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 78/154] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:29.897223 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f946f7-8905-49cc-b0cd-bc65032a30a9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:29.935924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 77/155] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:29.941336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec365b9-a454-4927-bab1-cbd12a98283f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:30.029054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f946f7-8905-49cc-b0cd-bc65032a30a9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:30.060030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec365b9-a454-4927-bab1-cbd12a98283f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:30.070699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154c33f-425e-431d-852b-0925ea770050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:30.072054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154c33f-425e-431d-852b-0925ea770050 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:30.072361 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154c33f-425e-431d-852b-0925ea770050 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:30.072646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154c33f-425e-431d-852b-0925ea770050 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144/users/9d7e37a916364b6c86f9d3b17437aa74/roles/a0d8f7cc5da940d1a33a8d08b79f833b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:30.075294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154c33f-425e-431d-852b-0925ea770050 None admin] RBAC: Authorizing `identity:create_grant(project_id=658d1c3291ff49e386ba21e2afa82144, user_id=9d7e37a916364b6c86f9d3b17437aa74, role_id=a0d8f7cc5da940d1a33a8d08b79f833b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:30.077080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154c33f-425e-431d-852b-0925ea770050 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:30.104738 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11670b-7159-48dc-9bdf-d473c824ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:30.105689 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11670b-7159-48dc-9bdf-d473c824ae5e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:30.105982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11670b-7159-48dc-9bdf-d473c824ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:30.106261 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11670b-7159-48dc-9bdf-d473c824ae5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:30.117929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11670b-7159-48dc-9bdf-d473c824ae5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:30.125339 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-ad11670b-7159-48dc-9bdf-d473c824ae5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:30.126977 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 78/156] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:30.133959 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11670b-7159-48dc-9bdf-d473c824ae5e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:30.176932 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 79/157] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:05:29 2022] PUT /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144/users/9d7e37a916364b6c86f9d3b17437aa74/roles/a0d8f7cc5da940d1a33a8d08b79f833b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:05:30.177859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154c33f-425e-431d-852b-0925ea770050 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:30.275685 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11670b-7159-48dc-9bdf-d473c824ae5e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:30.323919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5161dc1-d566-4012-a097-a22da3a34aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:30.325649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161dc1-d566-4012-a097-a22da3a34aed None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:30.326248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161dc1-d566-4012-a097-a22da3a34aed None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:30.326810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5161dc1-d566-4012-a097-a22da3a34aed None admin] PATH_INFO: `/v3/users/3d01d472ac8c4c32a41f169c9057727c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:30.328642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5161dc1-d566-4012-a097-a22da3a34aed None admin] RBAC: Authorizing `identity:get_user(user_id=3d01d472ac8c4c32a41f169c9057727c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:30.330759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5161dc1-d566-4012-a097-a22da3a34aed None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:30.333313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 79/158] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:30 2022] GET /identity/v3/users/3d01d472ac8c4c32a41f169c9057727c => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:30.334168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154c33f-425e-431d-852b-0925ea770050 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:30.334473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5161dc1-d566-4012-a097-a22da3a34aed None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:30.388632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da1e54-c6d3-42f5-815c-ec6fcccb7228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:30.389877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da1e54-c6d3-42f5-815c-ec6fcccb7228 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:30.390401 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da1e54-c6d3-42f5-815c-ec6fcccb7228 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:30.390891 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da1e54-c6d3-42f5-815c-ec6fcccb7228 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:30.405572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da1e54-c6d3-42f5-815c-ec6fcccb7228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:30.413907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-d1da1e54-c6d3-42f5-815c-ec6fcccb7228 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:05:30.416089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 80/159] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:05:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:30.417132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da1e54-c6d3-42f5-815c-ec6fcccb7228 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:30.469834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5161dc1-d566-4012-a097-a22da3a34aed None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:30.505992 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b35d-feae-4bc1-b7b1-9c4f9241a78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:30.506678 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b35d-feae-4bc1-b7b1-9c4f9241a78b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:30.507578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b35d-feae-4bc1-b7b1-9c4f9241a78b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:30.508448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b35d-feae-4bc1-b7b1-9c4f9241a78b None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:30.508922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9b35d-feae-4bc1-b7b1-9c4f9241a78b None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:30.509272 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9b35d-feae-4bc1-b7b1-9c4f9241a78b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:30.510706 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9b35d-feae-4bc1-b7b1-9c4f9241a78b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:30.519807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 80/160] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:30.520655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b35d-feae-4bc1-b7b1-9c4f9241a78b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:30.555516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da1e54-c6d3-42f5-815c-ec6fcccb7228 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:30.637775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aa029-fdec-404d-838b-d445448a8370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:30.638366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aa029-fdec-404d-838b-d445448a8370 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:30.638648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aa029-fdec-404d-838b-d445448a8370 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:30.638922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aa029-fdec-404d-838b-d445448a8370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:30.679440 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b35d-feae-4bc1-b7b1-9c4f9241a78b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:30.715711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7612-f89f-4bda-aabe-089eded05814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:30.716390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7612-f89f-4bda-aabe-089eded05814 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:30.716674 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7612-f89f-4bda-aabe-089eded05814 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:30.716953 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7612-f89f-4bda-aabe-089eded05814 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:30.717733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a7612-f89f-4bda-aabe-089eded05814 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:30.718047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a7612-f89f-4bda-aabe-089eded05814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:30.719436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a7612-f89f-4bda-aabe-089eded05814 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:30.731809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 81/161] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:05:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:30.732658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7612-f89f-4bda-aabe-089eded05814 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:30.746063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318aa029-fdec-404d-838b-d445448a8370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:30.748365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318aa029-fdec-404d-838b-d445448a8370 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:30.934060 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 81/162] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:30.934922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aa029-fdec-404d-838b-d445448a8370 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:30.948262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7612-f89f-4bda-aabe-089eded05814 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:31.018253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8e99-0ce5-408e-addf-e563a8b30bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:31.019153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8e99-0ce5-408e-addf-e563a8b30bbe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:31.019437 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8e99-0ce5-408e-addf-e563a8b30bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:31.019710 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8e99-0ce5-408e-addf-e563a8b30bbe None admin] PATH_INFO: `/v3/users/55c387b4a9af4a1d99f620de2f727870` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:31.020922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf8e99-0ce5-408e-addf-e563a8b30bbe None admin] RBAC: Authorizing `identity:get_user(user_id=55c387b4a9af4a1d99f620de2f727870)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:31.022440 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf8e99-0ce5-408e-addf-e563a8b30bbe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:31.024306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 82/163] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:30 2022] GET /identity/v3/users/55c387b4a9af4a1d99f620de2f727870 => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:31.025175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8e99-0ce5-408e-addf-e563a8b30bbe None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:31.147132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aa029-fdec-404d-838b-d445448a8370 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:31.211689 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8e99-0ce5-408e-addf-e563a8b30bbe None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:31.214765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32382a49-cf86-466b-b3f9-4cf876516683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:31.215648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382a49-cf86-466b-b3f9-4cf876516683 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:31.215923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382a49-cf86-466b-b3f9-4cf876516683 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:31.216193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382a49-cf86-466b-b3f9-4cf876516683 None admin] PATH_INFO: `/v3/users/55c387b4a9af4a1d99f620de2f727870` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:31.221374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32382a49-cf86-466b-b3f9-4cf876516683 None admin] RBAC: Authorizing `identity:get_user(user_id=55c387b4a9af4a1d99f620de2f727870)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:31.222839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32382a49-cf86-466b-b3f9-4cf876516683 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:31.224485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 82/164] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:30 2022] GET /identity/v3/users/55c387b4a9af4a1d99f620de2f727870 => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:31.236831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32382a49-cf86-466b-b3f9-4cf876516683 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:31.279577 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cb081-8c81-44c0-b575-6fa36b0a8653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:31.280449 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cb081-8c81-44c0-b575-6fa36b0a8653 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:31.280730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cb081-8c81-44c0-b575-6fa36b0a8653 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:31.281021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cb081-8c81-44c0-b575-6fa36b0a8653 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:31.286161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cb081-8c81-44c0-b575-6fa36b0a8653 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:31.287604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cb081-8c81-44c0-b575-6fa36b0a8653 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:31.290043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 83/165] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:31 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:31.295311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cb081-8c81-44c0-b575-6fa36b0a8653 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:31.357915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32382a49-cf86-466b-b3f9-4cf876516683 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:31.392662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f686924-8a53-42af-a0a5-35678c0cb61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:31.393347 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f686924-8a53-42af-a0a5-35678c0cb61b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:31.393628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f686924-8a53-42af-a0a5-35678c0cb61b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:31.393908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f686924-8a53-42af-a0a5-35678c0cb61b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:31.451796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cb081-8c81-44c0-b575-6fa36b0a8653 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:31.477578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f686924-8a53-42af-a0a5-35678c0cb61b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:31.478963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f686924-8a53-42af-a0a5-35678c0cb61b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:31.486945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627afe7-e3e9-4b1f-beeb-1b2347db3296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:31.488156 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627afe7-e3e9-4b1f-beeb-1b2347db3296 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:31.488570 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627afe7-e3e9-4b1f-beeb-1b2347db3296 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:31.489038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627afe7-e3e9-4b1f-beeb-1b2347db3296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:31.561285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627afe7-e3e9-4b1f-beeb-1b2347db3296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:31.562960 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627afe7-e3e9-4b1f-beeb-1b2347db3296 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:31.583707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 83/166] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:31.585296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f686924-8a53-42af-a0a5-35678c0cb61b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:31.671557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 84/167] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:31.672901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50463f8-c727-4d6d-bbfb-50e5bf94ebbc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:31.673207 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50463f8-c727-4d6d-bbfb-50e5bf94ebbc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:31.673483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50463f8-c727-4d6d-bbfb-50e5bf94ebbc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:31.674919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 85/168] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:31.682148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50463f8-c727-4d6d-bbfb-50e5bf94ebbc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:31.686293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f686924-8a53-42af-a0a5-35678c0cb61b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:31.744491 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea40dcc-152d-4891-984b-cd5717e435e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:31.745101 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea40dcc-152d-4891-984b-cd5717e435e4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:31.745385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea40dcc-152d-4891-984b-cd5717e435e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:31.745655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea40dcc-152d-4891-984b-cd5717e435e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:31.746496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea40dcc-152d-4891-984b-cd5717e435e4 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=658d1c3291ff49e386ba21e2afa82144, user.id=3d01d472ac8c4c32a41f169c9057727c) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:31.746802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea40dcc-152d-4891-984b-cd5717e435e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:31.748235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea40dcc-152d-4891-984b-cd5717e435e4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:31.760889 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 84/169] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:31 2022] GET /identity/v3/role_assignments?user.id=3d01d472ac8c4c32a41f169c9057727c&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:31.761712 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea40dcc-152d-4891-984b-cd5717e435e4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:31.843157 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50463f8-c727-4d6d-bbfb-50e5bf94ebbc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:31.880881 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274971de-5506-4ecc-b8ae-fcb2471a5178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:31.883128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274971de-5506-4ecc-b8ae-fcb2471a5178 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:31.883425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274971de-5506-4ecc-b8ae-fcb2471a5178 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:31.883705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274971de-5506-4ecc-b8ae-fcb2471a5178 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:31.885083 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274971de-5506-4ecc-b8ae-fcb2471a5178 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:31.887066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274971de-5506-4ecc-b8ae-fcb2471a5178 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:31.888892 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 86/170] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:31 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:31.890631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af706a-bfdd-430e-ab42-aeb646a04a8d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:31.890919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af706a-bfdd-430e-ab42-aeb646a04a8d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:31.891193 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af706a-bfdd-430e-ab42-aeb646a04a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:31.921431 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-34af706a-bfdd-430e-ab42-aeb646a04a8d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:31.923000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-34af706a-bfdd-430e-ab42-aeb646a04a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:32.009269 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 87/171] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:32.010065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af706a-bfdd-430e-ab42-aeb646a04a8d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:32.031275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea40dcc-152d-4891-984b-cd5717e435e4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:32.111420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc31a5c-4b2d-4bc5-8246-77b0934a27f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:32.112295 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc31a5c-4b2d-4bc5-8246-77b0934a27f5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:32.112576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc31a5c-4b2d-4bc5-8246-77b0934a27f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:32.112845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc31a5c-4b2d-4bc5-8246-77b0934a27f5 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:32.114118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc31a5c-4b2d-4bc5-8246-77b0934a27f5 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:32.115626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc31a5c-4b2d-4bc5-8246-77b0934a27f5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:32.118373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 85/172] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:31 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:32.124502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc31a5c-4b2d-4bc5-8246-77b0934a27f5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:32.162097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af706a-bfdd-430e-ab42-aeb646a04a8d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:32.213743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2856764-a70d-46f9-bf1f-ecff8d7c8922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:32.214427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856764-a70d-46f9-bf1f-ecff8d7c8922 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:32.214709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856764-a70d-46f9-bf1f-ecff8d7c8922 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:32.214982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856764-a70d-46f9-bf1f-ecff8d7c8922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:32.215832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2856764-a70d-46f9-bf1f-ecff8d7c8922 None admin] RBAC: Adding query filter params (role.id=a0c62419d02f426ea41c7faf22b2bf8a, scope.project.id=658d1c3291ff49e386ba21e2afa82144, user.id=55c387b4a9af4a1d99f620de2f727870) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:32.216148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2856764-a70d-46f9-bf1f-ecff8d7c8922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:32.218833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2856764-a70d-46f9-bf1f-ecff8d7c8922 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:32.226236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 88/173] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:32 2022] GET /identity/v3/role_assignments?user.id=55c387b4a9af4a1d99f620de2f727870&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:32.232836 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2856764-a70d-46f9-bf1f-ecff8d7c8922 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:32.273571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc31a5c-4b2d-4bc5-8246-77b0934a27f5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:32.353707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79bcc0-0f7a-4b20-ba3a-c739b1c79382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:32.354388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79bcc0-0f7a-4b20-ba3a-c739b1c79382 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:32.354673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79bcc0-0f7a-4b20-ba3a-c739b1c79382 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:32.354950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79bcc0-0f7a-4b20-ba3a-c739b1c79382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:32.355812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79bcc0-0f7a-4b20-ba3a-c739b1c79382 None admin] RBAC: Adding query filter params (role.id=b227940c19244df2b57662537283a467, scope.project.id=658d1c3291ff49e386ba21e2afa82144, user.id=55c387b4a9af4a1d99f620de2f727870) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:32.356124 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79bcc0-0f7a-4b20-ba3a-c739b1c79382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:32.357645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79bcc0-0f7a-4b20-ba3a-c739b1c79382 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:32.371159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 86/174] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:32 2022] GET /identity/v3/role_assignments?user.id=55c387b4a9af4a1d99f620de2f727870&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=b227940c19244df2b57662537283a467 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:32.404940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2856764-a70d-46f9-bf1f-ecff8d7c8922 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:32.443064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34619c19-e1ee-4221-851f-06bfe20f9d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:32.443872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34619c19-e1ee-4221-851f-06bfe20f9d6c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:32.444150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34619c19-e1ee-4221-851f-06bfe20f9d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:32.444462 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34619c19-e1ee-4221-851f-06bfe20f9d6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:32.457650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34619c19-e1ee-4221-851f-06bfe20f9d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:32.465633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-34619c19-e1ee-4221-851f-06bfe20f9d6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:32.467370 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 89/175] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:32.472747 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79bcc0-0f7a-4b20-ba3a-c739b1c79382 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:32.620071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79bcc0-0f7a-4b20-ba3a-c739b1c79382 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:32.656120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af383b9-b6be-4cb6-ae21-65d5f16f355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:32.656814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af383b9-b6be-4cb6-ae21-65d5f16f355a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:32.657127 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af383b9-b6be-4cb6-ae21-65d5f16f355a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:32.657400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af383b9-b6be-4cb6-ae21-65d5f16f355a None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:32.658167 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af383b9-b6be-4cb6-ae21-65d5f16f355a None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:32.658475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af383b9-b6be-4cb6-ae21-65d5f16f355a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:32.659903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af383b9-b6be-4cb6-ae21-65d5f16f355a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:32.680745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 87/176] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:32.690126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34619c19-e1ee-4221-851f-06bfe20f9d6c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:32.829889 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34619c19-e1ee-4221-851f-06bfe20f9d6c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:32.871296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c49ec-1aae-4b34-b237-4cc204c5132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:32.872111 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c49ec-1aae-4b34-b237-4cc204c5132b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:32.872390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c49ec-1aae-4b34-b237-4cc204c5132b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:32.872663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c49ec-1aae-4b34-b237-4cc204c5132b None admin] PATH_INFO: `/v3/users/55c387b4a9af4a1d99f620de2f727870` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:32.873982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c49ec-1aae-4b34-b237-4cc204c5132b None admin] RBAC: Authorizing `identity:get_user(user_id=55c387b4a9af4a1d99f620de2f727870)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:32.875455 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c49ec-1aae-4b34-b237-4cc204c5132b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:32.877197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 90/177] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:32 2022] GET /identity/v3/users/55c387b4a9af4a1d99f620de2f727870 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:32.883485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af383b9-b6be-4cb6-ae21-65d5f16f355a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:32.990355 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af383b9-b6be-4cb6-ae21-65d5f16f355a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:33.024788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1709da-5137-4649-a32c-76bce9dba32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:33.025469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1709da-5137-4649-a32c-76bce9dba32d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:33.025757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1709da-5137-4649-a32c-76bce9dba32d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:33.026039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1709da-5137-4649-a32c-76bce9dba32d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:33.095294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1709da-5137-4649-a32c-76bce9dba32d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:33.096773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1709da-5137-4649-a32c-76bce9dba32d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:33.201298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 88/178] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:33.206990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c49ec-1aae-4b34-b237-4cc204c5132b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:33.321490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c49ec-1aae-4b34-b237-4cc204c5132b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:33.359016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f53d4-a1ff-4e72-b8d4-cb1cffccc706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:33.359892 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f53d4-a1ff-4e72-b8d4-cb1cffccc706 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:33.360171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f53d4-a1ff-4e72-b8d4-cb1cffccc706 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:33.360449 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f53d4-a1ff-4e72-b8d4-cb1cffccc706 None admin] PATH_INFO: `/v3/projects/5421d9b6782c4ff78dba61b1112c633d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:33.361678 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f53d4-a1ff-4e72-b8d4-cb1cffccc706 None admin] RBAC: Authorizing `identity:get_project(project_id=5421d9b6782c4ff78dba61b1112c633d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:33.363132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f53d4-a1ff-4e72-b8d4-cb1cffccc706 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:33.364846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 91/179] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:33 2022] GET /identity/v3/projects/5421d9b6782c4ff78dba61b1112c633d => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:33.371315 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1709da-5137-4649-a32c-76bce9dba32d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:33.476430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1709da-5137-4649-a32c-76bce9dba32d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:33.510729 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdf706-af64-4c61-a254-7a50154c8125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:33.511394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdf706-af64-4c61-a254-7a50154c8125 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:33.511677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdf706-af64-4c61-a254-7a50154c8125 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:33.511954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdf706-af64-4c61-a254-7a50154c8125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:33.512787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdf706-af64-4c61-a254-7a50154c8125 None admin] RBAC: Adding query filter params (role.id=a0c62419d02f426ea41c7faf22b2bf8a, scope.project.id=5421d9b6782c4ff78dba61b1112c633d, user.id=55c387b4a9af4a1d99f620de2f727870) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:33.513123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdf706-af64-4c61-a254-7a50154c8125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:33.514562 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdf706-af64-4c61-a254-7a50154c8125 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:33.520672 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 89/180] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:33 2022] GET /identity/v3/role_assignments?user.id=55c387b4a9af4a1d99f620de2f727870&scope.project.id=5421d9b6782c4ff78dba61b1112c633d&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:33.582913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4356d51-e8dd-4bab-b5f2-7afda3f133f8 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:33.583245 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4356d51-e8dd-4bab-b5f2-7afda3f133f8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:33.583470 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4356d51-e8dd-4bab-b5f2-7afda3f133f8 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:33.585821 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 92/181] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:33.594046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb3dc8-6ae0-4898-a8a5-94b1f3b85f77 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:33.594361 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb3dc8-6ae0-4898-a8a5-94b1f3b85f77 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:33.594593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb3dc8-6ae0-4898-a8a5-94b1f3b85f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:33.619563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1bbb3dc8-6ae0-4898-a8a5-94b1f3b85f77 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:33.620815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1bbb3dc8-6ae0-4898-a8a5-94b1f3b85f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:33.704574 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 90/182] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:33.731499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4356d51-e8dd-4bab-b5f2-7afda3f133f8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:33.855182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4356d51-e8dd-4bab-b5f2-7afda3f133f8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:33.860479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638aaf-fbac-4e5a-a997-303724446b27 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:33.860768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638aaf-fbac-4e5a-a997-303724446b27 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:33.861074 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638aaf-fbac-4e5a-a997-303724446b27 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:33.862461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 91/183] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:33.872005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008f1c7-442f-4a6d-8d53-e9ab4e489825 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:33.872293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008f1c7-442f-4a6d-8d53-e9ab4e489825 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:33.872557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008f1c7-442f-4a6d-8d53-e9ab4e489825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:33.896466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6008f1c7-442f-4a6d-8d53-e9ab4e489825 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:33.898778 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6008f1c7-442f-4a6d-8d53-e9ab4e489825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:33.913666 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42730abe-68cd-4897-9bc7-ae6acfaa990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:33.914981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42730abe-68cd-4897-9bc7-ae6acfaa990b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:33.915458 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42730abe-68cd-4897-9bc7-ae6acfaa990b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:33.915920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42730abe-68cd-4897-9bc7-ae6acfaa990b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:33.917352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42730abe-68cd-4897-9bc7-ae6acfaa990b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:33.920103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42730abe-68cd-4897-9bc7-ae6acfaa990b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:33.922371 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 93/184] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:33.931116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42730abe-68cd-4897-9bc7-ae6acfaa990b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:33.981021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 92/185] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:34.008567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008f1c7-442f-4a6d-8d53-e9ab4e489825 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:34.046585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42730abe-68cd-4897-9bc7-ae6acfaa990b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:34.082829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4ea85-462a-4a20-88b6-86781491b9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:34.083505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4ea85-462a-4a20-88b6-86781491b9db None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.083792 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4ea85-462a-4a20-88b6-86781491b9db None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.084066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4ea85-462a-4a20-88b6-86781491b9db None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.085319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4ea85-462a-4a20-88b6-86781491b9db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:34.086841 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4ea85-462a-4a20-88b6-86781491b9db None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:34.113761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008f1c7-442f-4a6d-8d53-e9ab4e489825 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:34.145593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75321dac-5fc1-4854-93d1-b36a795f500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:34.146367 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75321dac-5fc1-4854-93d1-b36a795f500d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.146653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75321dac-5fc1-4854-93d1-b36a795f500d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.146931 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75321dac-5fc1-4854-93d1-b36a795f500d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.157369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75321dac-5fc1-4854-93d1-b36a795f500d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:34.164875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-75321dac-5fc1-4854-93d1-b36a795f500d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:05:34.166112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 93/186] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:05:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:34.170926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd034e7-0784-4566-b8c0-4c5196803fe6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.170926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd034e7-0784-4566-b8c0-4c5196803fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.170926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd034e7-0784-4566-b8c0-4c5196803fe6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.170926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 94/187] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:34.172139 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd034e7-0784-4566-b8c0-4c5196803fe6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:34.192991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 94/188] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:05:33 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:34.192991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993956f6-cc7d-4ce3-9271-8a8308f6b63c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.192991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993956f6-cc7d-4ce3-9271-8a8308f6b63c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.192991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993956f6-cc7d-4ce3-9271-8a8308f6b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.224513 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-993956f6-cc7d-4ce3-9271-8a8308f6b63c None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:34.227285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-993956f6-cc7d-4ce3-9271-8a8308f6b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:34.307499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 95/189] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:34.322259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd034e7-0784-4566-b8c0-4c5196803fe6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:34.336688 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993956f6-cc7d-4ce3-9271-8a8308f6b63c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:34.370394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038630-fd8f-4697-b70e-83b87177293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:34.371602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038630-fd8f-4697-b70e-83b87177293a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.371892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038630-fd8f-4697-b70e-83b87177293a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.372174 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038630-fd8f-4697-b70e-83b87177293a None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.373506 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7038630-fd8f-4697-b70e-83b87177293a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:34.373876 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7038630-fd8f-4697-b70e-83b87177293a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:34.376846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7038630-fd8f-4697-b70e-83b87177293a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:34.387739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 95/190] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:34.392135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038630-fd8f-4697-b70e-83b87177293a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:34.456433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993956f6-cc7d-4ce3-9271-8a8308f6b63c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:34.495508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414034f6-ba95-4ac0-8737-e65322a3d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:34.496334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414034f6-ba95-4ac0-8737-e65322a3d335 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.496670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414034f6-ba95-4ac0-8737-e65322a3d335 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.496900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414034f6-ba95-4ac0-8737-e65322a3d335 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.503202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038630-fd8f-4697-b70e-83b87177293a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:34.511817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414034f6-ba95-4ac0-8737-e65322a3d335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:34.519479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-414034f6-ba95-4ac0-8737-e65322a3d335 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:05:34.521104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 96/191] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:05:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:34.523275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b33f60-3e42-40ed-aded-78224aaa2869 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.523839 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b33f60-3e42-40ed-aded-78224aaa2869 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.523917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b33f60-3e42-40ed-aded-78224aaa2869 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.525338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 97/192] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:34.528741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b33f60-3e42-40ed-aded-78224aaa2869 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:34.542375 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe4e7-7453-47da-9f07-650c2ddf86b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:34.543280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe4e7-7453-47da-9f07-650c2ddf86b1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.543563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe4e7-7453-47da-9f07-650c2ddf86b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.543837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe4e7-7453-47da-9f07-650c2ddf86b1 None admin] PATH_INFO: `/v3/users/61e1c50e9c234d849588b7616d763175` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.560224 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe4e7-7453-47da-9f07-650c2ddf86b1 None admin] RBAC: Authorizing `identity:get_user(user_id=61e1c50e9c234d849588b7616d763175)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:34.561657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe4e7-7453-47da-9f07-650c2ddf86b1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:34.563390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 96/193] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:34 2022] GET /identity/v3/users/61e1c50e9c234d849588b7616d763175 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:34.564588 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31baee-15c5-4aab-ab06-13037ad992dc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.564875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31baee-15c5-4aab-ab06-13037ad992dc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.565242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31baee-15c5-4aab-ab06-13037ad992dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.584397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2e31baee-15c5-4aab-ab06-13037ad992dc None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:34.586708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2e31baee-15c5-4aab-ab06-13037ad992dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:34.650104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b33f60-3e42-40ed-aded-78224aaa2869 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:34.656812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 97/194] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:34.658296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31baee-15c5-4aab-ab06-13037ad992dc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:34.720093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a543c-2e58-4809-9e63-b92c40de3d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:34.720697 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a543c-2e58-4809-9e63-b92c40de3d5f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.720993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a543c-2e58-4809-9e63-b92c40de3d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.721282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a543c-2e58-4809-9e63-b92c40de3d5f None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.722035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a543c-2e58-4809-9e63-b92c40de3d5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:34.722344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a543c-2e58-4809-9e63-b92c40de3d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:34.723716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a543c-2e58-4809-9e63-b92c40de3d5f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:34.732614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 98/195] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:05:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:34.733479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a543c-2e58-4809-9e63-b92c40de3d5f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:34.764199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31baee-15c5-4aab-ab06-13037ad992dc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:34.799681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d4121-d5cb-41bd-86c9-3840dbd843f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:34.800673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d4121-d5cb-41bd-86c9-3840dbd843f5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.801183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d4121-d5cb-41bd-86c9-3840dbd843f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.801682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d4121-d5cb-41bd-86c9-3840dbd843f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.832951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a543c-2e58-4809-9e63-b92c40de3d5f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:34.867528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19dcf0-2f19-4e1f-9474-9a56ac4bb4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:34.868325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19dcf0-2f19-4e1f-9474-9a56ac4bb4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:34.868607 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19dcf0-2f19-4e1f-9474-9a56ac4bb4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:34.868879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19dcf0-2f19-4e1f-9474-9a56ac4bb4b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:34.872844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d4121-d5cb-41bd-86c9-3840dbd843f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:34.874725 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d4121-d5cb-41bd-86c9-3840dbd843f5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:34.879043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19dcf0-2f19-4e1f-9474-9a56ac4bb4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:34.886913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-ce19dcf0-2f19-4e1f-9474-9a56ac4bb4b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 14:05:34.887977 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 99/196] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:34.893369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19dcf0-2f19-4e1f-9474-9a56ac4bb4b6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:34.975930 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 98/197] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:34.977107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d4121-d5cb-41bd-86c9-3840dbd843f5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:34.992905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19dcf0-2f19-4e1f-9474-9a56ac4bb4b6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:35.026989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5848-9a85-4abd-a55a-e9817dcc39b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:35.027875 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5848-9a85-4abd-a55a-e9817dcc39b7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:35.028158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5848-9a85-4abd-a55a-e9817dcc39b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:35.028435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5848-9a85-4abd-a55a-e9817dcc39b7 None admin] PATH_INFO: `/v3/users/61e1c50e9c234d849588b7616d763175` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:35.029732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5848-9a85-4abd-a55a-e9817dcc39b7 None admin] RBAC: Authorizing `identity:get_user(user_id=61e1c50e9c234d849588b7616d763175)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:35.031211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5848-9a85-4abd-a55a-e9817dcc39b7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:35.033026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 100/198] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:34 2022] GET /identity/v3/users/61e1c50e9c234d849588b7616d763175 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:35.033631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5848-9a85-4abd-a55a-e9817dcc39b7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:35.093685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d4121-d5cb-41bd-86c9-3840dbd843f5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:35.139670 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13a03e-493d-40b4-8487-0ab60efb31a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:35.140878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13a03e-493d-40b4-8487-0ab60efb31a5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:35.141662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13a03e-493d-40b4-8487-0ab60efb31a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:35.142386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13a03e-493d-40b4-8487-0ab60efb31a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:35.143477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13a03e-493d-40b4-8487-0ab60efb31a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:35.143965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13a03e-493d-40b4-8487-0ab60efb31a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:35.146064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13a03e-493d-40b4-8487-0ab60efb31a5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:35.147054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5848-9a85-4abd-a55a-e9817dcc39b7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:35.157323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 99/199] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:35.158438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13a03e-493d-40b4-8487-0ab60efb31a5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:35.189335 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d13aa6-0db1-4769-937e-63458feeeb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:35.190349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d13aa6-0db1-4769-937e-63458feeeb75 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:35.190886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d13aa6-0db1-4769-937e-63458feeeb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:35.191264 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d13aa6-0db1-4769-937e-63458feeeb75 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:35.193185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d13aa6-0db1-4769-937e-63458feeeb75 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:35.195569 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d13aa6-0db1-4769-937e-63458feeeb75 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:35.198642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 101/200] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:35 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:35.199761 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d13aa6-0db1-4769-937e-63458feeeb75 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:35.284423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13a03e-493d-40b4-8487-0ab60efb31a5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:35.312979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d13aa6-0db1-4769-937e-63458feeeb75 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:35.326489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab538fa-5202-4b87-b0c3-87af7c2b9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:35.327146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab538fa-5202-4b87-b0c3-87af7c2b9c03 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:35.327427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab538fa-5202-4b87-b0c3-87af7c2b9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:35.327699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab538fa-5202-4b87-b0c3-87af7c2b9c03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:35.350427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e552-b354-40da-bff2-8ca6457c93f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:35.351762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e552-b354-40da-bff2-8ca6457c93f0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:35.352193 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e552-b354-40da-bff2-8ca6457c93f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:35.352611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e552-b354-40da-bff2-8ca6457c93f0 None admin] PATH_INFO: `/v3/users/9d7e37a916364b6c86f9d3b17437aa74` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:35.354020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6e552-b354-40da-bff2-8ca6457c93f0 None admin] RBAC: Authorizing `identity:get_user(user_id=9d7e37a916364b6c86f9d3b17437aa74)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:35.355640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6e552-b354-40da-bff2-8ca6457c93f0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:35.357494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 102/201] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:35 2022] GET /identity/v3/users/9d7e37a916364b6c86f9d3b17437aa74 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:35.358464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e552-b354-40da-bff2-8ca6457c93f0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:35.410020 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab538fa-5202-4b87-b0c3-87af7c2b9c03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:35.411500 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab538fa-5202-4b87-b0c3-87af7c2b9c03 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:35.462360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e552-b354-40da-bff2-8ca6457c93f0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:35.507126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0326341-1100-4ce7-8546-12bd013e50ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:35.507789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0326341-1100-4ce7-8546-12bd013e50ee None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:35.508069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0326341-1100-4ce7-8546-12bd013e50ee None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:35.508343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0326341-1100-4ce7-8546-12bd013e50ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:35.509728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0326341-1100-4ce7-8546-12bd013e50ee None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=67f9fe5832664d93a19363ec71de67b0, user.id=61e1c50e9c234d849588b7616d763175) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:35.510047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0326341-1100-4ce7-8546-12bd013e50ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:35.512137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0326341-1100-4ce7-8546-12bd013e50ee None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:35.525082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 103/202] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:35 2022] GET /identity/v3/role_assignments?user.id=61e1c50e9c234d849588b7616d763175&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:35.528418 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0326341-1100-4ce7-8546-12bd013e50ee None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:35.549690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 100/203] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:35.556595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab538fa-5202-4b87-b0c3-87af7c2b9c03 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:35.735836 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0326341-1100-4ce7-8546-12bd013e50ee None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:35.745585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab538fa-5202-4b87-b0c3-87af7c2b9c03 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:35.793820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c849d5-5fc7-49fe-8e6f-e9eb4bc5683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:35.795259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c849d5-5fc7-49fe-8e6f-e9eb4bc5683e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:35.795873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c849d5-5fc7-49fe-8e6f-e9eb4bc5683e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:35.796444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c849d5-5fc7-49fe-8e6f-e9eb4bc5683e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:35.813921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77eb0b6-807a-4026-98e9-a7789e745358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:35.814787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eb0b6-807a-4026-98e9-a7789e745358 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:35.815068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eb0b6-807a-4026-98e9-a7789e745358 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:35.815339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eb0b6-807a-4026-98e9-a7789e745358 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:35.821714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77eb0b6-807a-4026-98e9-a7789e745358 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:35.823447 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77eb0b6-807a-4026-98e9-a7789e745358 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:35.825509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 101/204] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:35 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:35.831032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77eb0b6-807a-4026-98e9-a7789e745358 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:35.871152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c849d5-5fc7-49fe-8e6f-e9eb4bc5683e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:35.873282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c849d5-5fc7-49fe-8e6f-e9eb4bc5683e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:35.982528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 104/205] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:35.988703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c849d5-5fc7-49fe-8e6f-e9eb4bc5683e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:36.097403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c849d5-5fc7-49fe-8e6f-e9eb4bc5683e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:36.103156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77eb0b6-807a-4026-98e9-a7789e745358 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:36.135165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1997b11-fc9d-4b82-a77d-6025f32f6803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:36.136387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997b11-fc9d-4b82-a77d-6025f32f6803 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:36.136865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997b11-fc9d-4b82-a77d-6025f32f6803 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:36.137383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997b11-fc9d-4b82-a77d-6025f32f6803 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:36.139334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1997b11-fc9d-4b82-a77d-6025f32f6803 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:36.141066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1997b11-fc9d-4b82-a77d-6025f32f6803 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:36.142989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 105/206] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:35 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:36.149765 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1997b11-fc9d-4b82-a77d-6025f32f6803 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:36.213691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839aa0-6ecf-4440-bd87-db9f7ae60f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:36.214359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839aa0-6ecf-4440-bd87-db9f7ae60f68 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:36.214653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839aa0-6ecf-4440-bd87-db9f7ae60f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:36.214926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839aa0-6ecf-4440-bd87-db9f7ae60f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:36.215773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839aa0-6ecf-4440-bd87-db9f7ae60f68 None admin] RBAC: Adding query filter params (role.id=b227940c19244df2b57662537283a467, scope.project.id=67f9fe5832664d93a19363ec71de67b0, user.id=61e1c50e9c234d849588b7616d763175) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:36.216088 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839aa0-6ecf-4440-bd87-db9f7ae60f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:36.217573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839aa0-6ecf-4440-bd87-db9f7ae60f68 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:36.235428 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 102/207] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:35 2022] GET /identity/v3/role_assignments?user.id=61e1c50e9c234d849588b7616d763175&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=b227940c19244df2b57662537283a467 => generated 259 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:36.259508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1997b11-fc9d-4b82-a77d-6025f32f6803 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:36.299076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ef623-bff9-43fe-8df0-1ef691672e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:36.300232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef623-bff9-43fe-8df0-1ef691672e11 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:36.300726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef623-bff9-43fe-8df0-1ef691672e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:36.301229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef623-bff9-43fe-8df0-1ef691672e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:36.302286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef623-bff9-43fe-8df0-1ef691672e11 None admin] RBAC: Adding query filter params (role.id=a0d8f7cc5da940d1a33a8d08b79f833b, scope.project.id=658d1c3291ff49e386ba21e2afa82144, user.id=9d7e37a916364b6c86f9d3b17437aa74) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:36.302938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef623-bff9-43fe-8df0-1ef691672e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:36.305172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef623-bff9-43fe-8df0-1ef691672e11 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:36.312491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 106/208] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:36 2022] GET /identity/v3/role_assignments?user.id=9d7e37a916364b6c86f9d3b17437aa74&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=a0d8f7cc5da940d1a33a8d08b79f833b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:36.788806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa3eb-95bb-4b2a-94f1-31fbc6b1331e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:36.789350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa3eb-95bb-4b2a-94f1-31fbc6b1331e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:36.789621 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa3eb-95bb-4b2a-94f1-31fbc6b1331e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:36.791246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 103/209] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:36.796849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e47edb-6753-4e66-8f7f-ab45e07be73e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:36.797735 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e47edb-6753-4e66-8f7f-ab45e07be73e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:36.798195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e47edb-6753-4e66-8f7f-ab45e07be73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:36.816260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e8e47edb-6753-4e66-8f7f-ab45e07be73e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:36.817814 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e8e47edb-6753-4e66-8f7f-ab45e07be73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:36.893070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 107/210] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:36.918526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aa3eb-95bb-4b2a-94f1-31fbc6b1331e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:36.964063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503303-fd3c-44d8-9abc-5e35d3e5c379 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:36.964691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503303-fd3c-44d8-9abc-5e35d3e5c379 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:36.965201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503303-fd3c-44d8-9abc-5e35d3e5c379 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:36.966783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 108/211] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:36.973396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a5c72-d2a1-46db-a430-ef12e42c5baa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:36.973917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a5c72-d2a1-46db-a430-ef12e42c5baa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:36.974414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a5c72-d2a1-46db-a430-ef12e42c5baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:36.993778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7f7a5c72-d2a1-46db-a430-ef12e42c5baa None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:36.995709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7f7a5c72-d2a1-46db-a430-ef12e42c5baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:37.045662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aa3eb-95bb-4b2a-94f1-31fbc6b1331e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:37.077649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 109/212] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:37.089184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9ed31-1e02-4f91-9d3e-1ec934cdc92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:37.090027 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9ed31-1e02-4f91-9d3e-1ec934cdc92f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:37.090307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9ed31-1e02-4f91-9d3e-1ec934cdc92f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:37.090584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9ed31-1e02-4f91-9d3e-1ec934cdc92f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:37.101663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9ed31-1e02-4f91-9d3e-1ec934cdc92f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:37.103763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a5c72-d2a1-46db-a430-ef12e42c5baa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:37.109701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-0ce9ed31-1e02-4f91-9d3e-1ec934cdc92f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:37.112994 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 104/213] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:37.118657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9ed31-1e02-4f91-9d3e-1ec934cdc92f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:37.217080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a5c72-d2a1-46db-a430-ef12e42c5baa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:37.246083 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9ed31-1e02-4f91-9d3e-1ec934cdc92f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:37.255740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff1b2a-2f5d-4067-8586-74b32bb495ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:37.256570 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff1b2a-2f5d-4067-8586-74b32bb495ff None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:37.257000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff1b2a-2f5d-4067-8586-74b32bb495ff None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:37.257522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff1b2a-2f5d-4067-8586-74b32bb495ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:37.258721 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff1b2a-2f5d-4067-8586-74b32bb495ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:37.260187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff1b2a-2f5d-4067-8586-74b32bb495ff None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:37.261818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 110/214] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:37.267122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff1b2a-2f5d-4067-8586-74b32bb495ff None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:37.287076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4083685-4cb9-438d-b319-032b3b7fd79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:37.288533 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4083685-4cb9-438d-b319-032b3b7fd79c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:37.289012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4083685-4cb9-438d-b319-032b3b7fd79c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:37.289874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4083685-4cb9-438d-b319-032b3b7fd79c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:37.291131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4083685-4cb9-438d-b319-032b3b7fd79c None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:37.291608 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4083685-4cb9-438d-b319-032b3b7fd79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:37.294034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4083685-4cb9-438d-b319-032b3b7fd79c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:37.305951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 105/215] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:37.311199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4083685-4cb9-438d-b319-032b3b7fd79c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:37.379174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff1b2a-2f5d-4067-8586-74b32bb495ff None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:37.421794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75611369-3f9a-4c30-9cfe-fa748d9c5a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:37.422623 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75611369-3f9a-4c30-9cfe-fa748d9c5a2c None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:37.423195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75611369-3f9a-4c30-9cfe-fa748d9c5a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:37.423477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75611369-3f9a-4c30-9cfe-fa748d9c5a2c None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:37.424456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75611369-3f9a-4c30-9cfe-fa748d9c5a2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:37.425681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4083685-4cb9-438d-b319-032b3b7fd79c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:37.425902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75611369-3f9a-4c30-9cfe-fa748d9c5a2c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:37.461124 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cf215-ff57-43c5-bc9d-98a3e9f1f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:37.462007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cf215-ff57-43c5-bc9d-98a3e9f1f57a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:37.462301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cf215-ff57-43c5-bc9d-98a3e9f1f57a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:37.462570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cf215-ff57-43c5-bc9d-98a3e9f1f57a None admin] PATH_INFO: `/v3/users/ffdfa22627eb47d4a13ba4949fe61dd0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:37.476836 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cf215-ff57-43c5-bc9d-98a3e9f1f57a None admin] RBAC: Authorizing `identity:get_user(user_id=ffdfa22627eb47d4a13ba4949fe61dd0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:37.478283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cf215-ff57-43c5-bc9d-98a3e9f1f57a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:37.480229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 106/216] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:37 2022] GET /identity/v3/users/ffdfa22627eb47d4a13ba4949fe61dd0 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:37.485464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cf215-ff57-43c5-bc9d-98a3e9f1f57a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:37.549313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 111/217] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:05:37 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:37.601764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cf215-ff57-43c5-bc9d-98a3e9f1f57a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:37.641172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602bcb5-517b-49d4-9f48-2664acbae7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:37.642254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602bcb5-517b-49d4-9f48-2664acbae7bb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:37.642737 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602bcb5-517b-49d4-9f48-2664acbae7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:37.643274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602bcb5-517b-49d4-9f48-2664acbae7bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:37.723583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602bcb5-517b-49d4-9f48-2664acbae7bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:37.725175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602bcb5-517b-49d4-9f48-2664acbae7bb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:37.832893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 107/218] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 14:05:37.839416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75611369-3f9a-4c30-9cfe-fa748d9c5a2c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:37.941495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75611369-3f9a-4c30-9cfe-fa748d9c5a2c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:37.979733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f1976-10c1-4530-b94b-6d021cf01177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:37.980836 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1976-10c1-4530-b94b-6d021cf01177 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:37.981319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1976-10c1-4530-b94b-6d021cf01177 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:37.981770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1976-10c1-4530-b94b-6d021cf01177 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:37.982995 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f1976-10c1-4530-b94b-6d021cf01177 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:37.984461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f1976-10c1-4530-b94b-6d021cf01177 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:37.987520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 112/219] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:37 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:37.992615 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602bcb5-517b-49d4-9f48-2664acbae7bb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:38.106809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602bcb5-517b-49d4-9f48-2664acbae7bb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:38.154083 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853c42f-81ae-41a9-8162-7005c790ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:38.154744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853c42f-81ae-41a9-8162-7005c790ab2a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:38.155030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853c42f-81ae-41a9-8162-7005c790ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:38.155309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853c42f-81ae-41a9-8162-7005c790ab2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:38.156150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853c42f-81ae-41a9-8162-7005c790ab2a None admin] RBAC: Adding query filter params (role.id=a0c62419d02f426ea41c7faf22b2bf8a, scope.project.id=67f9fe5832664d93a19363ec71de67b0, user.id=ffdfa22627eb47d4a13ba4949fe61dd0) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:38.156465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853c42f-81ae-41a9-8162-7005c790ab2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:38.157980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853c42f-81ae-41a9-8162-7005c790ab2a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:38.168118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 108/220] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:37 2022] GET /identity/v3/role_assignments?user.id=ffdfa22627eb47d4a13ba4949fe61dd0&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:38.196059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0788-1c9b-4728-9174-107f876c87ac None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:38.196703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0788-1c9b-4728-9174-107f876c87ac None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:38.197207 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0788-1c9b-4728-9174-107f876c87ac None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:38.199365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 113/221] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:38.204807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8b67-8a4d-483b-8873-09e732915d5f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:38.205165 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8b67-8a4d-483b-8873-09e732915d5f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:38.205448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8b67-8a4d-483b-8873-09e732915d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:38.223818 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-155f8b67-8a4d-483b-8873-09e732915d5f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:38.225094 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-155f8b67-8a4d-483b-8873-09e732915d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:38.300330 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 109/222] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:38.339492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d0788-1c9b-4728-9174-107f876c87ac None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:38.473664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d0788-1c9b-4728-9174-107f876c87ac None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:38.515137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63416e-e051-446c-ad53-acdc1543c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:38.517575 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63416e-e051-446c-ad53-acdc1543c598 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:38.518047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63416e-e051-446c-ad53-acdc1543c598 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:38.518457 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63416e-e051-446c-ad53-acdc1543c598 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:38.533868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63416e-e051-446c-ad53-acdc1543c598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:38.541692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-1d63416e-e051-446c-ad53-acdc1543c598 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:05:38.543350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 114/223] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:05:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:38.548756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f8b67-8a4d-483b-8873-09e732915d5f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:38.696306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f8b67-8a4d-483b-8873-09e732915d5f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:38.742662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8ce78-613c-4ff3-82ce-3753901ee04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:38.744016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8ce78-613c-4ff3-82ce-3753901ee04a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:38.744627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8ce78-613c-4ff3-82ce-3753901ee04a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:38.745207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8ce78-613c-4ff3-82ce-3753901ee04a None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:38.746122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8ce78-613c-4ff3-82ce-3753901ee04a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:38.746570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8ce78-613c-4ff3-82ce-3753901ee04a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:38.748106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8ce78-613c-4ff3-82ce-3753901ee04a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:38.761158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 110/224] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:38.768328 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63416e-e051-446c-ad53-acdc1543c598 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:38.843649 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54e8e6-fd2c-44c7-89ad-70c95697275c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:38.844179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54e8e6-fd2c-44c7-89ad-70c95697275c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:38.844179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54e8e6-fd2c-44c7-89ad-70c95697275c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:38.845749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 111/225] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:38.852444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8ffe3-6262-49ba-bcbe-817294376c16 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:38.852801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8ffe3-6262-49ba-bcbe-817294376c16 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:38.853022 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8ffe3-6262-49ba-bcbe-817294376c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:38.886655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f2c8ffe3-6262-49ba-bcbe-817294376c16 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:38.887847 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f2c8ffe3-6262-49ba-bcbe-817294376c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:38.898167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63416e-e051-446c-ad53-acdc1543c598 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:38.932574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71522898-955f-4d3c-b6fd-3b86e36b92df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:38.933865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522898-955f-4d3c-b6fd-3b86e36b92df None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:38.934343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522898-955f-4d3c-b6fd-3b86e36b92df None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:38.934802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522898-955f-4d3c-b6fd-3b86e36b92df None admin] PATH_INFO: `/v3/users/61e1c50e9c234d849588b7616d763175` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:38.936182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71522898-955f-4d3c-b6fd-3b86e36b92df None admin] RBAC: Authorizing `identity:get_user(user_id=61e1c50e9c234d849588b7616d763175)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:38.937976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71522898-955f-4d3c-b6fd-3b86e36b92df None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:38.940176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 115/226] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:38 2022] GET /identity/v3/users/61e1c50e9c234d849588b7616d763175 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:38.955996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71522898-955f-4d3c-b6fd-3b86e36b92df None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:38.990321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 112/227] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:39.057230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8ffe3-6262-49ba-bcbe-817294376c16 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:39.092660 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71522898-955f-4d3c-b6fd-3b86e36b92df None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:39.130735 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97062e5-d2e6-403c-a158-f01787ad76ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:39.132816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97062e5-d2e6-403c-a158-f01787ad76ab None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:39.133401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97062e5-d2e6-403c-a158-f01787ad76ab None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:39.133867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97062e5-d2e6-403c-a158-f01787ad76ab None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:39.137826 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97062e5-d2e6-403c-a158-f01787ad76ab None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:39.139507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97062e5-d2e6-403c-a158-f01787ad76ab None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:39.144789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 116/228] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:38 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:39.150008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97062e5-d2e6-403c-a158-f01787ad76ab None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:39.259120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8ffe3-6262-49ba-bcbe-817294376c16 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:39.278654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97062e5-d2e6-403c-a158-f01787ad76ab None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:39.323550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc199746-eb08-46cb-b805-53ba36e97dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:39.324767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc199746-eb08-46cb-b805-53ba36e97dca None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:39.325262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc199746-eb08-46cb-b805-53ba36e97dca None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:39.325726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc199746-eb08-46cb-b805-53ba36e97dca None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0/users/61e1c50e9c234d849588b7616d763175/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:39.327956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc199746-eb08-46cb-b805-53ba36e97dca None admin] RBAC: Authorizing `identity:create_grant(project_id=67f9fe5832664d93a19363ec71de67b0, user_id=61e1c50e9c234d849588b7616d763175, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:39.329653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc199746-eb08-46cb-b805-53ba36e97dca None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:39.345348 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a223b-112b-4c1f-8c14-ca148953234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:39.346430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a223b-112b-4c1f-8c14-ca148953234e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:39.346863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a223b-112b-4c1f-8c14-ca148953234e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:39.348509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a223b-112b-4c1f-8c14-ca148953234e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:39.358901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a223b-112b-4c1f-8c14-ca148953234e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:39.367879 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-842a223b-112b-4c1f-8c14-ca148953234e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:05:39.369286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 113/229] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:05:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:39.375032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a223b-112b-4c1f-8c14-ca148953234e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:39.406424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 117/230] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:05:39 2022] PUT /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0/users/61e1c50e9c234d849588b7616d763175/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:05:39.501958 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a223b-112b-4c1f-8c14-ca148953234e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:39.538408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d6462-af1c-45bf-9e96-f269dbbd4e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:39.539527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d6462-af1c-45bf-9e96-f269dbbd4e58 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:39.540102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d6462-af1c-45bf-9e96-f269dbbd4e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:39.540614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d6462-af1c-45bf-9e96-f269dbbd4e58 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:39.541806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d6462-af1c-45bf-9e96-f269dbbd4e58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:39.542283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d6462-af1c-45bf-9e96-f269dbbd4e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:39.543877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d6462-af1c-45bf-9e96-f269dbbd4e58 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:39.553261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 114/231] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:05:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:39.561130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc199746-eb08-46cb-b805-53ba36e97dca None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:39.674452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc199746-eb08-46cb-b805-53ba36e97dca None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:39.708382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a539617-f18b-4f6c-98a1-c094730b6ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:39.709293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a539617-f18b-4f6c-98a1-c094730b6ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:39.710369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a539617-f18b-4f6c-98a1-c094730b6ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:39.710848 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a539617-f18b-4f6c-98a1-c094730b6ac3 None admin] PATH_INFO: `/v3/users/61e1c50e9c234d849588b7616d763175` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:39.712280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a539617-f18b-4f6c-98a1-c094730b6ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=61e1c50e9c234d849588b7616d763175)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:39.713778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a539617-f18b-4f6c-98a1-c094730b6ac3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:39.715648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 118/232] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:39 2022] GET /identity/v3/users/61e1c50e9c234d849588b7616d763175 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:39.721123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d6462-af1c-45bf-9e96-f269dbbd4e58 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:39.837618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d6462-af1c-45bf-9e96-f269dbbd4e58 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:39.873071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518dee1-7aff-4f50-b9e7-0c78094f2942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:39.873939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518dee1-7aff-4f50-b9e7-0c78094f2942 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:39.874216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518dee1-7aff-4f50-b9e7-0c78094f2942 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:39.874485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518dee1-7aff-4f50-b9e7-0c78094f2942 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:39.875671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518dee1-7aff-4f50-b9e7-0c78094f2942 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:39.877152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518dee1-7aff-4f50-b9e7-0c78094f2942 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:39.878941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 115/233] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:39 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:39.885533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a539617-f18b-4f6c-98a1-c094730b6ac3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:40.005187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a539617-f18b-4f6c-98a1-c094730b6ac3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:40.059000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d3e3b-7c68-41df-94e5-d0a8f19b455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:40.059895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d3e3b-7c68-41df-94e5-d0a8f19b455e None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:40.060182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d3e3b-7c68-41df-94e5-d0a8f19b455e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:40.060459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d3e3b-7c68-41df-94e5-d0a8f19b455e None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0/users/61e1c50e9c234d849588b7616d763175/roles/b227940c19244df2b57662537283a467` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:40.062768 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d3e3b-7c68-41df-94e5-d0a8f19b455e None admin] RBAC: Authorizing `identity:create_grant(project_id=67f9fe5832664d93a19363ec71de67b0, user_id=61e1c50e9c234d849588b7616d763175, role_id=b227940c19244df2b57662537283a467)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:40.064221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d3e3b-7c68-41df-94e5-d0a8f19b455e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:40.171176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 119/234] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:05:39 2022] PUT /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0/users/61e1c50e9c234d849588b7616d763175/roles/b227940c19244df2b57662537283a467 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:05:40.356602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e392f-a374-45c8-85a6-5f75c52084d9 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:40.356777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e392f-a374-45c8-85a6-5f75c52084d9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:40.357093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e392f-a374-45c8-85a6-5f75c52084d9 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:40.358488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 116/235] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:40.363869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8cbab-89cd-491e-a648-18bf4654fead None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:40.364161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8cbab-89cd-491e-a648-18bf4654fead None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:40.364446 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8cbab-89cd-491e-a648-18bf4654fead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:40.389290 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-72e8cbab-89cd-491e-a648-18bf4654fead None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:40.390503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-72e8cbab-89cd-491e-a648-18bf4654fead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:40.474216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 120/236] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:40.502012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e392f-a374-45c8-85a6-5f75c52084d9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:40.631903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e392f-a374-45c8-85a6-5f75c52084d9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:40.637469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba0aa1-989e-40af-9752-08b619ab178a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:40.638028 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba0aa1-989e-40af-9752-08b619ab178a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:40.638525 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba0aa1-989e-40af-9752-08b619ab178a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:40.640395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 121/237] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:40.647293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb47f9c-611d-4b25-a4b0-62878259865b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:40.647597 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb47f9c-611d-4b25-a4b0-62878259865b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:40.647855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb47f9c-611d-4b25-a4b0-62878259865b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:40.681770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-acb47f9c-611d-4b25-a4b0-62878259865b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:40.682971 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-acb47f9c-611d-4b25-a4b0-62878259865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:40.685081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d816fb-7185-49a7-b48d-f4bbf37ec3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:40.685943 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d816fb-7185-49a7-b48d-f4bbf37ec3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:40.686229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d816fb-7185-49a7-b48d-f4bbf37ec3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:40.686507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d816fb-7185-49a7-b48d-f4bbf37ec3a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:40.700870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d816fb-7185-49a7-b48d-f4bbf37ec3a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:40.708835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-f0d816fb-7185-49a7-b48d-f4bbf37ec3a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 14:05:40.711501 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 117/238] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:40.717556 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d816fb-7185-49a7-b48d-f4bbf37ec3a7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:40.798387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 122/239] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:40.829274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb47f9c-611d-4b25-a4b0-62878259865b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:40.905511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d816fb-7185-49a7-b48d-f4bbf37ec3a7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:40.949286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226243e2-3663-44a9-a996-20cdc1b4512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:40.949976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226243e2-3663-44a9-a996-20cdc1b4512d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:40.950260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226243e2-3663-44a9-a996-20cdc1b4512d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:40.950531 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226243e2-3663-44a9-a996-20cdc1b4512d None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:40.951294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226243e2-3663-44a9-a996-20cdc1b4512d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:40.951598 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226243e2-3663-44a9-a996-20cdc1b4512d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:40.953024 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226243e2-3663-44a9-a996-20cdc1b4512d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:40.963117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 118/240] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:40.968374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226243e2-3663-44a9-a996-20cdc1b4512d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:41.002058 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb47f9c-611d-4b25-a4b0-62878259865b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:41.043266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f977a-326f-4654-860d-5b55f65829c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:41.044095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f977a-326f-4654-860d-5b55f65829c4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:41.044383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f977a-326f-4654-860d-5b55f65829c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:41.048990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f977a-326f-4654-860d-5b55f65829c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:41.048990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f977a-326f-4654-860d-5b55f65829c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:41.048990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f977a-326f-4654-860d-5b55f65829c4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:41.049297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 123/241] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:41.057937 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f977a-326f-4654-860d-5b55f65829c4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:41.111093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226243e2-3663-44a9-a996-20cdc1b4512d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:41.148885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4c8b9-9882-4490-90b6-15d616a909b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:41.150195 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4c8b9-9882-4490-90b6-15d616a909b6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:41.150672 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4c8b9-9882-4490-90b6-15d616a909b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:41.151138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4c8b9-9882-4490-90b6-15d616a909b6 None admin] PATH_INFO: `/v3/users/290f0f6a7b92413c82a0eec967847d33` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:41.168629 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4c8b9-9882-4490-90b6-15d616a909b6 None admin] RBAC: Authorizing `identity:get_user(user_id=290f0f6a7b92413c82a0eec967847d33)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:41.170421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4c8b9-9882-4490-90b6-15d616a909b6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:41.175431 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 119/242] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:40 2022] GET /identity/v3/users/290f0f6a7b92413c82a0eec967847d33 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:41.180845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4c8b9-9882-4490-90b6-15d616a909b6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:41.237410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f977a-326f-4654-860d-5b55f65829c4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:41.272516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7500a-6791-469d-8bbc-7826799c6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:41.273549 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7500a-6791-469d-8bbc-7826799c6376 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:41.273998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7500a-6791-469d-8bbc-7826799c6376 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:41.274429 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7500a-6791-469d-8bbc-7826799c6376 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:41.275293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7500a-6791-469d-8bbc-7826799c6376 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:41.276996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7500a-6791-469d-8bbc-7826799c6376 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:41.343864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4c8b9-9882-4490-90b6-15d616a909b6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:41.379452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990f17-f990-4899-8b7d-22e5298754ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:41.380176 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990f17-f990-4899-8b7d-22e5298754ae None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:41.380464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990f17-f990-4899-8b7d-22e5298754ae None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:41.380741 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990f17-f990-4899-8b7d-22e5298754ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:41.406703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 124/243] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:05:41 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:41.425312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dcb5d-0e9a-4337-ab16-f98c44527639 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:41.425938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dcb5d-0e9a-4337-ab16-f98c44527639 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:41.426410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dcb5d-0e9a-4337-ab16-f98c44527639 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:41.432993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 125/244] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:41.434894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121b341-f531-42cf-b40a-d0508e66acbf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:41.435445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121b341-f531-42cf-b40a-d0508e66acbf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:41.435963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121b341-f531-42cf-b40a-d0508e66acbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:41.460991 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8990f17-f990-4899-8b7d-22e5298754ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:41.460991 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8990f17-f990-4899-8b7d-22e5298754ae None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:41.474239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0121b341-f531-42cf-b40a-d0508e66acbf None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:41.476198 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0121b341-f531-42cf-b40a-d0508e66acbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:41.578914 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 120/245] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:41.585772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990f17-f990-4899-8b7d-22e5298754ae None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:41.619087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 126/246] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:41.648007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121b341-f531-42cf-b40a-d0508e66acbf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:41.737914 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990f17-f990-4899-8b7d-22e5298754ae None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:41.790336 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0776cb6-a2d4-4e04-8947-5d0b1d9cca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:41.791678 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0776cb6-a2d4-4e04-8947-5d0b1d9cca8c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:41.792112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0776cb6-a2d4-4e04-8947-5d0b1d9cca8c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:41.792396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0776cb6-a2d4-4e04-8947-5d0b1d9cca8c None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:41.793654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0776cb6-a2d4-4e04-8947-5d0b1d9cca8c None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:41.795305 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0776cb6-a2d4-4e04-8947-5d0b1d9cca8c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:41.795798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121b341-f531-42cf-b40a-d0508e66acbf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:41.797669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 121/247] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:41 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:41.802992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0776cb6-a2d4-4e04-8947-5d0b1d9cca8c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:41.852259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffd956-ae84-4791-809b-e7e39b622beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:41.853329 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffd956-ae84-4791-809b-e7e39b622beb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:41.853621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffd956-ae84-4791-809b-e7e39b622beb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:41.856064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffd956-ae84-4791-809b-e7e39b622beb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:41.872073 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffd956-ae84-4791-809b-e7e39b622beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:41.882139 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-f6ffd956-ae84-4791-809b-e7e39b622beb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:41.883704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 127/248] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:41.890718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffd956-ae84-4791-809b-e7e39b622beb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:41.940218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0776cb6-a2d4-4e04-8947-5d0b1d9cca8c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:41.979197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0be2f-cb24-464b-9180-8fde936e9aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:41.979933 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0be2f-cb24-464b-9180-8fde936e9aef None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:41.980219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0be2f-cb24-464b-9180-8fde936e9aef None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:41.980546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0be2f-cb24-464b-9180-8fde936e9aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:41.981424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0be2f-cb24-464b-9180-8fde936e9aef None admin] RBAC: Adding query filter params (role.id=a0d8f7cc5da940d1a33a8d08b79f833b, scope.project.id=67f9fe5832664d93a19363ec71de67b0, user.id=290f0f6a7b92413c82a0eec967847d33) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:41.981743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0be2f-cb24-464b-9180-8fde936e9aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:41.983246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0be2f-cb24-464b-9180-8fde936e9aef None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:41.989173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 122/249] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:41 2022] GET /identity/v3/role_assignments?user.id=290f0f6a7b92413c82a0eec967847d33&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=a0d8f7cc5da940d1a33a8d08b79f833b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:41.999880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffd956-ae84-4791-809b-e7e39b622beb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:42.042533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e27553-ffa3-4b88-9504-ad938c1c397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:42.043233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e27553-ffa3-4b88-9504-ad938c1c397f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:42.043523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e27553-ffa3-4b88-9504-ad938c1c397f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:42.044104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e27553-ffa3-4b88-9504-ad938c1c397f None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:42.044578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e27553-ffa3-4b88-9504-ad938c1c397f None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:42.044890 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e27553-ffa3-4b88-9504-ad938c1c397f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:42.046380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e27553-ffa3-4b88-9504-ad938c1c397f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:42.057378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 128/250] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:42.064196 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0be2f-cb24-464b-9180-8fde936e9aef None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:42.183020 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0be2f-cb24-464b-9180-8fde936e9aef None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:42.222009 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ac40-a126-42dc-9d5c-ae9a966339e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:42.223286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ac40-a126-42dc-9d5c-ae9a966339e6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:42.223791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ac40-a126-42dc-9d5c-ae9a966339e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:42.224258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ac40-a126-42dc-9d5c-ae9a966339e6 None admin] PATH_INFO: `/v3/users/ffdfa22627eb47d4a13ba4949fe61dd0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:42.225839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95ac40-a126-42dc-9d5c-ae9a966339e6 None admin] RBAC: Authorizing `identity:get_user(user_id=ffdfa22627eb47d4a13ba4949fe61dd0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:42.227512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95ac40-a126-42dc-9d5c-ae9a966339e6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:42.229407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 123/251] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:42 2022] GET /identity/v3/users/ffdfa22627eb47d4a13ba4949fe61dd0 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:42.234909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e27553-ffa3-4b88-9504-ad938c1c397f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:42.339915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e27553-ffa3-4b88-9504-ad938c1c397f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:42.380064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a655b9-2337-44e1-a71d-511171076868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:42.381863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a655b9-2337-44e1-a71d-511171076868 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:42.382329 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a655b9-2337-44e1-a71d-511171076868 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:42.382876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a655b9-2337-44e1-a71d-511171076868 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:42.384301 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a655b9-2337-44e1-a71d-511171076868 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:42.385955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a655b9-2337-44e1-a71d-511171076868 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:42.387985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 129/252] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:42 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:42.393784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ac40-a126-42dc-9d5c-ae9a966339e6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:42.409093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fbe84-4eea-4490-97bd-640261e3cc1b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:42.409647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fbe84-4eea-4490-97bd-640261e3cc1b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:42.410097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fbe84-4eea-4490-97bd-640261e3cc1b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:42.411634 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 130/253] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:42.418233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbce0d-121d-418a-beb5-8624a833fa8b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:42.418772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbce0d-121d-418a-beb5-8624a833fa8b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:42.419225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbce0d-121d-418a-beb5-8624a833fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:42.448893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-eecbce0d-121d-418a-beb5-8624a833fa8b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:42.451927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eecbce0d-121d-418a-beb5-8624a833fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:42.587878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 131/254] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:42.591001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ac40-a126-42dc-9d5c-ae9a966339e6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:42.630492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc642-f32b-4247-bffb-36218b619cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:42.631820 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc642-f32b-4247-bffb-36218b619cd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:42.632278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc642-f32b-4247-bffb-36218b619cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:42.632760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc642-f32b-4247-bffb-36218b619cd0 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0/users/ffdfa22627eb47d4a13ba4949fe61dd0/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:42.635012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cc642-f32b-4247-bffb-36218b619cd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f9fe5832664d93a19363ec71de67b0, user_id=ffdfa22627eb47d4a13ba4949fe61dd0, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:42.636651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cc642-f32b-4247-bffb-36218b619cd0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:42.648867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbce0d-121d-418a-beb5-8624a833fa8b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:42.731374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 124/255] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:05:42 2022] PUT /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0/users/ffdfa22627eb47d4a13ba4949fe61dd0/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:05:42.775170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbce0d-121d-418a-beb5-8624a833fa8b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:42.812856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cb5f6-1acb-4c4c-9802-46652b26171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:42.813785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb5f6-1acb-4c4c-9802-46652b26171e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:42.814070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb5f6-1acb-4c4c-9802-46652b26171e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:42.814347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb5f6-1acb-4c4c-9802-46652b26171e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:42.831381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cb5f6-1acb-4c4c-9802-46652b26171e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:42.839385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-ac5cb5f6-1acb-4c4c-9802-46652b26171e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:05:42.841067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 132/256] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:05:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:42.850321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc642-f32b-4247-bffb-36218b619cd0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:42.966037 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc642-f32b-4247-bffb-36218b619cd0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:43.008794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbd534-8c6a-4ad5-9239-a718dc66c8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:43.009498 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd534-8c6a-4ad5-9239-a718dc66c8de None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:43.009787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd534-8c6a-4ad5-9239-a718dc66c8de None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:43.010065 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd534-8c6a-4ad5-9239-a718dc66c8de None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:43.010825 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbd534-8c6a-4ad5-9239-a718dc66c8de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:43.011134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbd534-8c6a-4ad5-9239-a718dc66c8de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:43.012552 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbd534-8c6a-4ad5-9239-a718dc66c8de None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:43.025599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 125/257] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:43.031338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cb5f6-1acb-4c4c-9802-46652b26171e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:43.146380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cb5f6-1acb-4c4c-9802-46652b26171e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:43.182686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1905f2-e23a-42d9-8374-a9e816b6c42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:43.183565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1905f2-e23a-42d9-8374-a9e816b6c42e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:43.183845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1905f2-e23a-42d9-8374-a9e816b6c42e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:43.184121 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1905f2-e23a-42d9-8374-a9e816b6c42e None admin] PATH_INFO: `/v3/users/61e1c50e9c234d849588b7616d763175` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:43.185371 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1905f2-e23a-42d9-8374-a9e816b6c42e None admin] RBAC: Authorizing `identity:get_user(user_id=61e1c50e9c234d849588b7616d763175)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:43.186986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1905f2-e23a-42d9-8374-a9e816b6c42e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:43.188863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 133/258] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:43 2022] GET /identity/v3/users/61e1c50e9c234d849588b7616d763175 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:43.195060 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbd534-8c6a-4ad5-9239-a718dc66c8de None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:43.243898 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986ad4-2fa6-445c-afbb-0d8a6f8ee469 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:43.244182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986ad4-2fa6-445c-afbb-0d8a6f8ee469 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:43.244461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986ad4-2fa6-445c-afbb-0d8a6f8ee469 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:43.245938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 134/259] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:43.252897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b30f2-4b32-4227-980f-96ab94f51c57 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:43.253210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b30f2-4b32-4227-980f-96ab94f51c57 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:43.253488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b30f2-4b32-4227-980f-96ab94f51c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:43.274753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8c8b30f2-4b32-4227-980f-96ab94f51c57 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:43.275943 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8c8b30f2-4b32-4227-980f-96ab94f51c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:43.364634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbd534-8c6a-4ad5-9239-a718dc66c8de None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:43.376088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 135/260] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:43.416705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b30f2-4b32-4227-980f-96ab94f51c57 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:43.418453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb806b26-9c3c-4ceb-94c1-04fae1458b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:43.419312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806b26-9c3c-4ceb-94c1-04fae1458b72 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:43.419770 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806b26-9c3c-4ceb-94c1-04fae1458b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:43.420217 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806b26-9c3c-4ceb-94c1-04fae1458b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:43.559412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb806b26-9c3c-4ceb-94c1-04fae1458b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:43.560892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb806b26-9c3c-4ceb-94c1-04fae1458b72 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:43.580565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b30f2-4b32-4227-980f-96ab94f51c57 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:43.632924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41b6fc-5082-48cf-8335-0188af779e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:43.633768 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41b6fc-5082-48cf-8335-0188af779e60 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:43.634048 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41b6fc-5082-48cf-8335-0188af779e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:43.634320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41b6fc-5082-48cf-8335-0188af779e60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:43.650022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41b6fc-5082-48cf-8335-0188af779e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:43.657357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-eb41b6fc-5082-48cf-8335-0188af779e60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:05:43.658598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 136/261] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:05:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:43.669049 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 126/262] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:43.672072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41b6fc-5082-48cf-8335-0188af779e60 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:43.673417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb806b26-9c3c-4ceb-94c1-04fae1458b72 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:43.838400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb806b26-9c3c-4ceb-94c1-04fae1458b72 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:43.857211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41b6fc-5082-48cf-8335-0188af779e60 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:43.905390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e872f8-0413-4a14-a348-ec7ef116dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:43.906296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e872f8-0413-4a14-a348-ec7ef116dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:43.906580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e872f8-0413-4a14-a348-ec7ef116dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:43.906853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e872f8-0413-4a14-a348-ec7ef116dbf8 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:43.909025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e872f8-0413-4a14-a348-ec7ef116dbf8 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:43.910492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e872f8-0413-4a14-a348-ec7ef116dbf8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:43.914034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 127/263] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:43 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:43.920306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e872f8-0413-4a14-a348-ec7ef116dbf8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:43.925630 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc2737-41c7-44b1-9e76-58d7244dda00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:43.926312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2737-41c7-44b1-9e76-58d7244dda00 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:43.926594 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2737-41c7-44b1-9e76-58d7244dda00 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:43.926867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2737-41c7-44b1-9e76-58d7244dda00 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:43.927617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc2737-41c7-44b1-9e76-58d7244dda00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:43.928486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc2737-41c7-44b1-9e76-58d7244dda00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:43.929896 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc2737-41c7-44b1-9e76-58d7244dda00 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:43.948662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 137/264] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:05:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:43.953624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc2737-41c7-44b1-9e76-58d7244dda00 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:44.029327 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e872f8-0413-4a14-a348-ec7ef116dbf8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:44.065694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3311e-ff65-4c51-a422-7b4814433c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:44.066718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3311e-ff65-4c51-a422-7b4814433c76 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:44.067242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3311e-ff65-4c51-a422-7b4814433c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:44.067660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3311e-ff65-4c51-a422-7b4814433c76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:44.069226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3311e-ff65-4c51-a422-7b4814433c76 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=67f9fe5832664d93a19363ec71de67b0, user.id=61e1c50e9c234d849588b7616d763175) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:44.069687 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3311e-ff65-4c51-a422-7b4814433c76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:44.071481 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3311e-ff65-4c51-a422-7b4814433c76 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:44.078471 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 128/265] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:43 2022] GET /identity/v3/role_assignments?user.id=61e1c50e9c234d849588b7616d763175&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:44.181224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc2737-41c7-44b1-9e76-58d7244dda00 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:44.255126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008957-68d6-4454-94dd-e42e2e60e38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:44.256738 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008957-68d6-4454-94dd-e42e2e60e38c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:44.257122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008957-68d6-4454-94dd-e42e2e60e38c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:44.257550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008957-68d6-4454-94dd-e42e2e60e38c None admin] PATH_INFO: `/v3/users/61e1c50e9c234d849588b7616d763175` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:44.261820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0008957-68d6-4454-94dd-e42e2e60e38c None admin] RBAC: Authorizing `identity:get_user(user_id=61e1c50e9c234d849588b7616d763175)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:44.263322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0008957-68d6-4454-94dd-e42e2e60e38c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:44.265149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 138/266] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:43 2022] GET /identity/v3/users/61e1c50e9c234d849588b7616d763175 => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:44.270984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3311e-ff65-4c51-a422-7b4814433c76 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:44.410958 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3311e-ff65-4c51-a422-7b4814433c76 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:44.446188 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b87621-961a-4a96-b751-89c06628f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:44.447115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87621-961a-4a96-b751-89c06628f81a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:44.447830 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87621-961a-4a96-b751-89c06628f81a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:44.448307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87621-961a-4a96-b751-89c06628f81a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:44.517300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b87621-961a-4a96-b751-89c06628f81a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:44.519053 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b87621-961a-4a96-b751-89c06628f81a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:44.621955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 129/267] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:44.627261 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008957-68d6-4454-94dd-e42e2e60e38c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:44.738198 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008957-68d6-4454-94dd-e42e2e60e38c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:44.772389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24cae6-ad77-4e7f-a837-34b389d3f979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:44.773298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24cae6-ad77-4e7f-a837-34b389d3f979 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:44.773581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24cae6-ad77-4e7f-a837-34b389d3f979 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:44.773854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24cae6-ad77-4e7f-a837-34b389d3f979 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:44.775094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24cae6-ad77-4e7f-a837-34b389d3f979 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:44.776574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24cae6-ad77-4e7f-a837-34b389d3f979 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:44.778715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 139/268] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:44 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:44.786490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b87621-961a-4a96-b751-89c06628f81a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:44.893786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b87621-961a-4a96-b751-89c06628f81a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:44.940365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb547b5-efc0-4132-af4c-0c17d70fdbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:44.941081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb547b5-efc0-4132-af4c-0c17d70fdbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:44.941378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb547b5-efc0-4132-af4c-0c17d70fdbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:44.941639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb547b5-efc0-4132-af4c-0c17d70fdbb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:44.942482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb547b5-efc0-4132-af4c-0c17d70fdbb2 None admin] RBAC: Adding query filter params (role.id=b227940c19244df2b57662537283a467, scope.project.id=67f9fe5832664d93a19363ec71de67b0, user.id=61e1c50e9c234d849588b7616d763175) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:44.942799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb547b5-efc0-4132-af4c-0c17d70fdbb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:44.944498 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb547b5-efc0-4132-af4c-0c17d70fdbb2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:44.951448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 130/269] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:44 2022] GET /identity/v3/role_assignments?user.id=61e1c50e9c234d849588b7616d763175&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=b227940c19244df2b57662537283a467 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:45.206703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df715c5-582a-4d60-a8d7-f05222f1b949 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:45.207239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df715c5-582a-4d60-a8d7-f05222f1b949 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:45.207239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df715c5-582a-4d60-a8d7-f05222f1b949 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:45.208678 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 140/270] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:45.214752 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d8155-5b2d-4816-ae96-6de3e3b177c5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:45.215695 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d8155-5b2d-4816-ae96-6de3e3b177c5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:45.216154 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d8155-5b2d-4816-ae96-6de3e3b177c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:45.239886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-676d8155-5b2d-4816-ae96-6de3e3b177c5 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:45.241906 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-676d8155-5b2d-4816-ae96-6de3e3b177c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:45.324502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 131/271] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:45.350843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df715c5-582a-4d60-a8d7-f05222f1b949 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:45.475416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df715c5-582a-4d60-a8d7-f05222f1b949 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:45.517693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c8622-e20b-4a98-9fd0-244ae9b1b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:45.518515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8622-e20b-4a98-9fd0-244ae9b1b982 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:45.518800 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8622-e20b-4a98-9fd0-244ae9b1b982 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:45.519076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8622-e20b-4a98-9fd0-244ae9b1b982 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:45.519430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567384-5ca9-43f8-85cb-b4862c9e0864 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:45.519725 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567384-5ca9-43f8-85cb-b4862c9e0864 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:45.520003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567384-5ca9-43f8-85cb-b4862c9e0864 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:45.525528 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 132/272] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:45.535004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c8622-e20b-4a98-9fd0-244ae9b1b982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:45.535483 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e3b0-ea1c-45fa-a235-1ecbef1cc805 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:45.535967 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e3b0-ea1c-45fa-a235-1ecbef1cc805 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:45.536459 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e3b0-ea1c-45fa-a235-1ecbef1cc805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:45.542985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-0e2c8622-e20b-4a98-9fd0-244ae9b1b982 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:45.544074 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 141/273] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:45.550666 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c8622-e20b-4a98-9fd0-244ae9b1b982 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:45.557530 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9a51e3b0-ea1c-45fa-a235-1ecbef1cc805 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:45.558899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9a51e3b0-ea1c-45fa-a235-1ecbef1cc805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:45.646612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 133/274] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:45.648465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d29916-172c-4605-942e-44df002561d9 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:45.649059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d29916-172c-4605-942e-44df002561d9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:45.649486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d29916-172c-4605-942e-44df002561d9 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:45.651498 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 134/275] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:45.653174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c8622-e20b-4a98-9fd0-244ae9b1b982 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:45.658719 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3ad7-95b3-4cfd-a112-b3a7be881182 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:45.659165 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3ad7-95b3-4cfd-a112-b3a7be881182 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:45.659584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3ad7-95b3-4cfd-a112-b3a7be881182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:45.679582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b84c3ad7-95b3-4cfd-a112-b3a7be881182 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:45.680764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b84c3ad7-95b3-4cfd-a112-b3a7be881182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:45.705646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9544cc-c529-4e2e-8bf7-e07968ff83be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:45.706325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9544cc-c529-4e2e-8bf7-e07968ff83be None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:45.706636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9544cc-c529-4e2e-8bf7-e07968ff83be None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:45.706883 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9544cc-c529-4e2e-8bf7-e07968ff83be None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:45.707628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9544cc-c529-4e2e-8bf7-e07968ff83be None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:45.707934 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9544cc-c529-4e2e-8bf7-e07968ff83be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:45.709605 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9544cc-c529-4e2e-8bf7-e07968ff83be None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:45.719031 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 142/276] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:45.720009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9544cc-c529-4e2e-8bf7-e07968ff83be None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:45.749221 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 135/277] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:45.749221 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c3ad7-95b3-4cfd-a112-b3a7be881182 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:45.828215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9544cc-c529-4e2e-8bf7-e07968ff83be None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:45.858359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c3ad7-95b3-4cfd-a112-b3a7be881182 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:45.861329 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c4121-62c8-445d-ba64-fa11562ab116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:45.862125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4121-62c8-445d-ba64-fa11562ab116 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:45.862410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4121-62c8-445d-ba64-fa11562ab116 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:45.862687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4121-62c8-445d-ba64-fa11562ab116 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:45.863862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c4121-62c8-445d-ba64-fa11562ab116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:45.866118 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c4121-62c8-445d-ba64-fa11562ab116 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:45.868036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 143/278] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:45.868640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c4121-62c8-445d-ba64-fa11562ab116 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:45.894404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e4b79-d4a7-4441-b28d-c3f995e24859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:45.895448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e4b79-d4a7-4441-b28d-c3f995e24859 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:45.895736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e4b79-d4a7-4441-b28d-c3f995e24859 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:45.896006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e4b79-d4a7-4441-b28d-c3f995e24859 None admin] PATH_INFO: `/v3/users/985430dc98a74344bffe5ca5d8f0adb7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:45.909493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e4b79-d4a7-4441-b28d-c3f995e24859 None admin] RBAC: Authorizing `identity:get_user(user_id=985430dc98a74344bffe5ca5d8f0adb7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:45.910959 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e4b79-d4a7-4441-b28d-c3f995e24859 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:45.913577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 136/279] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:45 2022] GET /identity/v3/users/985430dc98a74344bffe5ca5d8f0adb7 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:45.917825 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e4b79-d4a7-4441-b28d-c3f995e24859 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:45.976076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c4121-62c8-445d-ba64-fa11562ab116 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:46.016837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b547ce-8f1f-4272-90bd-9fab850b865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:46.018044 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b547ce-8f1f-4272-90bd-9fab850b865d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:46.018403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b547ce-8f1f-4272-90bd-9fab850b865d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:46.018683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b547ce-8f1f-4272-90bd-9fab850b865d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:46.019226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e4b79-d4a7-4441-b28d-c3f995e24859 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:46.031687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b547ce-8f1f-4272-90bd-9fab850b865d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:46.041590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-a8b547ce-8f1f-4272-90bd-9fab850b865d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 14:05:46.043270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 144/280] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:46.044052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b547ce-8f1f-4272-90bd-9fab850b865d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:46.054814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0205ab0-ce7f-4201-924c-805388ef7331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:46.055478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0205ab0-ce7f-4201-924c-805388ef7331 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:46.055758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0205ab0-ce7f-4201-924c-805388ef7331 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:46.056031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0205ab0-ce7f-4201-924c-805388ef7331 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:46.056739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0205ab0-ce7f-4201-924c-805388ef7331 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:46.058200 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0205ab0-ce7f-4201-924c-805388ef7331 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:46.141949 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 137/281] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:05:45 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:46.143256 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b547ce-8f1f-4272-90bd-9fab850b865d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:46.154025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0205ab0-ce7f-4201-924c-805388ef7331 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:46.181257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231de93a-1b3f-410f-b725-1681e40b9c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:46.181930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de93a-1b3f-410f-b725-1681e40b9c62 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:46.182229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de93a-1b3f-410f-b725-1681e40b9c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:46.182479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de93a-1b3f-410f-b725-1681e40b9c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:46.183323 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de93a-1b3f-410f-b725-1681e40b9c62 None admin] RBAC: Adding query filter params (role.id=a0c62419d02f426ea41c7faf22b2bf8a, user.id=985430dc98a74344bffe5ca5d8f0adb7, scope.system=all) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:46.183639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de93a-1b3f-410f-b725-1681e40b9c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:46.185130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de93a-1b3f-410f-b725-1681e40b9c62 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:46.190780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 145/282] 10.222.0.61 () {56 vars in 1308 bytes} [Tue Apr 12 14:05:46 2022] GET /identity/v3/role_assignments?user.id=985430dc98a74344bffe5ca5d8f0adb7&scope.system=all&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:46.191931 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fd1fc-6d56-49c3-bffc-1823f35965e6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:46.192221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fd1fc-6d56-49c3-bffc-1823f35965e6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:46.192496 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fd1fc-6d56-49c3-bffc-1823f35965e6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:46.197060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 146/283] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:46.201610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8988e-95ca-428e-a2a1-4fdfedd0bb07 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:46.202180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8988e-95ca-428e-a2a1-4fdfedd0bb07 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:46.202596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8988e-95ca-428e-a2a1-4fdfedd0bb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:46.231894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cda8988e-95ca-428e-a2a1-4fdfedd0bb07 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:46.233462 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cda8988e-95ca-428e-a2a1-4fdfedd0bb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:46.287920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0205ab0-ce7f-4201-924c-805388ef7331 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:46.319757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 147/284] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:46.340791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d345bb-cbd4-4bb9-9d6b-830a29aa911f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:46.341903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d345bb-cbd4-4bb9-9d6b-830a29aa911f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:46.342391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d345bb-cbd4-4bb9-9d6b-830a29aa911f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:46.342666 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d345bb-cbd4-4bb9-9d6b-830a29aa911f None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:46.343425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d345bb-cbd4-4bb9-9d6b-830a29aa911f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:46.343735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d345bb-cbd4-4bb9-9d6b-830a29aa911f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:46.345243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d345bb-cbd4-4bb9-9d6b-830a29aa911f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:46.348796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8988e-95ca-428e-a2a1-4fdfedd0bb07 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:46.355974 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 138/285] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:46.363298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d345bb-cbd4-4bb9-9d6b-830a29aa911f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:46.468926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8988e-95ca-428e-a2a1-4fdfedd0bb07 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:46.489799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d345bb-cbd4-4bb9-9d6b-830a29aa911f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:46.513801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a6c3-d4bc-4ffe-ac79-6c1f09e88775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:46.514340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a6c3-d4bc-4ffe-ac79-6c1f09e88775 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:46.515238 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a6c3-d4bc-4ffe-ac79-6c1f09e88775 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:46.515238 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93a6c3-d4bc-4ffe-ac79-6c1f09e88775 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:46.529111 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93a6c3-d4bc-4ffe-ac79-6c1f09e88775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:46.533250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a997a5-4791-47f5-a9ef-eefc06e88eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:46.534205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a997a5-4791-47f5-a9ef-eefc06e88eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:46.534486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a997a5-4791-47f5-a9ef-eefc06e88eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:46.534760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a997a5-4791-47f5-a9ef-eefc06e88eb3 None admin] PATH_INFO: `/v3/users/290f0f6a7b92413c82a0eec967847d33` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:46.535952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a997a5-4791-47f5-a9ef-eefc06e88eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=290f0f6a7b92413c82a0eec967847d33)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:46.536051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-7d93a6c3-d4bc-4ffe-ac79-6c1f09e88775 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:46.538070 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a997a5-4791-47f5-a9ef-eefc06e88eb3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:46.539532 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 148/286] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:46.541558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 139/287] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:46 2022] GET /identity/v3/users/290f0f6a7b92413c82a0eec967847d33 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:46.545268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a6c3-d4bc-4ffe-ac79-6c1f09e88775 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:46.546465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a997a5-4791-47f5-a9ef-eefc06e88eb3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:46.678545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93a6c3-d4bc-4ffe-ac79-6c1f09e88775 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:46.680030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a997a5-4791-47f5-a9ef-eefc06e88eb3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:46.714696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34f388-b397-40ab-937c-4a06f9a3f7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:46.715468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f388-b397-40ab-937c-4a06f9a3f7ec None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:46.715755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f388-b397-40ab-937c-4a06f9a3f7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:46.716033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f388-b397-40ab-937c-4a06f9a3f7ec None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:46.716452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66709c-6257-477a-a675-882e87f4467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:46.716783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34f388-b397-40ab-937c-4a06f9a3f7ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:46.717122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34f388-b397-40ab-937c-4a06f9a3f7ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:46.717965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66709c-6257-477a-a675-882e87f4467d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:46.718443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66709c-6257-477a-a675-882e87f4467d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:46.718541 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34f388-b397-40ab-937c-4a06f9a3f7ec None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:46.720089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66709c-6257-477a-a675-882e87f4467d None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:46.721556 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66709c-6257-477a-a675-882e87f4467d None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:46.723197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66709c-6257-477a-a675-882e87f4467d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:46.726064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 140/288] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:46 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:46.727880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 149/289] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:46.731235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66709c-6257-477a-a675-882e87f4467d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:46.733342 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34f388-b397-40ab-937c-4a06f9a3f7ec None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:46.845142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34f388-b397-40ab-937c-4a06f9a3f7ec None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:46.879801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a714f6d-75a0-45c1-9a3c-8032ed94d031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:46.880773 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a714f6d-75a0-45c1-9a3c-8032ed94d031 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:46.881094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a714f6d-75a0-45c1-9a3c-8032ed94d031 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:46.881525 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a714f6d-75a0-45c1-9a3c-8032ed94d031 None admin] PATH_INFO: `/v3/users/ffdfa22627eb47d4a13ba4949fe61dd0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:46.882753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a714f6d-75a0-45c1-9a3c-8032ed94d031 None admin] RBAC: Authorizing `identity:get_user(user_id=ffdfa22627eb47d4a13ba4949fe61dd0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:46.884181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a714f6d-75a0-45c1-9a3c-8032ed94d031 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:46.885876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 150/290] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:46 2022] GET /identity/v3/users/ffdfa22627eb47d4a13ba4949fe61dd0 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:46.891308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a714f6d-75a0-45c1-9a3c-8032ed94d031 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:46.956698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66709c-6257-477a-a675-882e87f4467d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:46.990524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a714f6d-75a0-45c1-9a3c-8032ed94d031 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:47.003128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cc0a0-3d93-49ea-9f81-034510a51ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:47.004277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cc0a0-3d93-49ea-9f81-034510a51ca7 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:47.004783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cc0a0-3d93-49ea-9f81-034510a51ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:47.005273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cc0a0-3d93-49ea-9f81-034510a51ca7 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0/users/290f0f6a7b92413c82a0eec967847d33/roles/a0d8f7cc5da940d1a33a8d08b79f833b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:47.012276 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cc0a0-3d93-49ea-9f81-034510a51ca7 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f9fe5832664d93a19363ec71de67b0, user_id=290f0f6a7b92413c82a0eec967847d33, role_id=a0d8f7cc5da940d1a33a8d08b79f833b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:47.013970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cc0a0-3d93-49ea-9f81-034510a51ca7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:47.024869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc5782-ef46-47c5-a50b-88ce3f9062c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:47.025545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc5782-ef46-47c5-a50b-88ce3f9062c7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:47.025832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc5782-ef46-47c5-a50b-88ce3f9062c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:47.026118 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc5782-ef46-47c5-a50b-88ce3f9062c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:47.093600 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc5782-ef46-47c5-a50b-88ce3f9062c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:47.095139 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc5782-ef46-47c5-a50b-88ce3f9062c7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:47.122798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 141/291] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:05:46 2022] PUT /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0/users/290f0f6a7b92413c82a0eec967847d33/roles/a0d8f7cc5da940d1a33a8d08b79f833b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:05:47.204916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 151/292] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 14:05:47.206629 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cc0a0-3d93-49ea-9f81-034510a51ca7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:47.355395 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cc0a0-3d93-49ea-9f81-034510a51ca7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:47.393615 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ec5eb-bbf1-4930-acc1-0d82a9078fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:47.394971 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ec5eb-bbf1-4930-acc1-0d82a9078fdb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:47.395452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ec5eb-bbf1-4930-acc1-0d82a9078fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:47.395922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ec5eb-bbf1-4930-acc1-0d82a9078fdb None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:47.397461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ec5eb-bbf1-4930-acc1-0d82a9078fdb None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:47.399130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ec5eb-bbf1-4930-acc1-0d82a9078fdb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:47.401401 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 142/293] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:47 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:47.407092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc5782-ef46-47c5-a50b-88ce3f9062c7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:47.546975 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc5782-ef46-47c5-a50b-88ce3f9062c7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:47.594228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883f5e3-eb51-4d26-ac74-eaf71e7a92f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:47.594887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883f5e3-eb51-4d26-ac74-eaf71e7a92f4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:47.595171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883f5e3-eb51-4d26-ac74-eaf71e7a92f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:47.595433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883f5e3-eb51-4d26-ac74-eaf71e7a92f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:47.596263 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883f5e3-eb51-4d26-ac74-eaf71e7a92f4 None admin] RBAC: Adding query filter params (role.id=a0c62419d02f426ea41c7faf22b2bf8a, scope.project.id=67f9fe5832664d93a19363ec71de67b0, user.id=ffdfa22627eb47d4a13ba4949fe61dd0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:47.596571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883f5e3-eb51-4d26-ac74-eaf71e7a92f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:47.598012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883f5e3-eb51-4d26-ac74-eaf71e7a92f4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:47.609828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 152/294] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:47 2022] GET /identity/v3/role_assignments?user.id=ffdfa22627eb47d4a13ba4949fe61dd0&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:48.980955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37f007-1133-45fa-bcfe-93e5130aad95 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:48.981913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37f007-1133-45fa-bcfe-93e5130aad95 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:48.981913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37f007-1133-45fa-bcfe-93e5130aad95 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:48.983133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 143/295] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:48.983364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cfbf9-4e06-476a-a3c0-3275dcad3d28 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:48.983730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cfbf9-4e06-476a-a3c0-3275dcad3d28 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:48.983919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cfbf9-4e06-476a-a3c0-3275dcad3d28 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:48.985558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 153/296] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:48.988377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8c75-5ffa-424f-898d-9517d680b6d2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:48.988662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8c75-5ffa-424f-898d-9517d680b6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:48.988937 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8c75-5ffa-424f-898d-9517d680b6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:48.991149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8895a9b-ac86-49be-83aa-0a7aaef35d26 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:48.991611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8895a9b-ac86-49be-83aa-0a7aaef35d26 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:48.991893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8895a9b-ac86-49be-83aa-0a7aaef35d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.009785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d8895a9b-ac86-49be-83aa-0a7aaef35d26 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:49.010288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-167e8c75-5ffa-424f-898d-9517d680b6d2 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:49.010965 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d8895a9b-ac86-49be-83aa-0a7aaef35d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:49.011859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-167e8c75-5ffa-424f-898d-9517d680b6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:49.077822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 154/297] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:49.078596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 144/298] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:49.079147 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe7961-ed95-4f40-b60e-f102178c41f2 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.079432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe7961-ed95-4f40-b60e-f102178c41f2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.079702 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe7961-ed95-4f40-b60e-f102178c41f2 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.081131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 155/299] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:49.092983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdafd5-770d-4f78-a604-c5d50be1c6d2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.092983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdafd5-770d-4f78-a604-c5d50be1c6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.092983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdafd5-770d-4f78-a604-c5d50be1c6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.104640 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bbfdafd5-770d-4f78-a604-c5d50be1c6d2 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:49.105850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bbfdafd5-770d-4f78-a604-c5d50be1c6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:49.107398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe7961-ed95-4f40-b60e-f102178c41f2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:49.171616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 145/300] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:49.172462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdafd5-770d-4f78-a604-c5d50be1c6d2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:49.219483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe7961-ed95-4f40-b60e-f102178c41f2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:49.258661 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5733ff-a0be-4135-9bb1-1dd2b15981fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:49.259376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5733ff-a0be-4135-9bb1-1dd2b15981fd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.259655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5733ff-a0be-4135-9bb1-1dd2b15981fd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.259926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5733ff-a0be-4135-9bb1-1dd2b15981fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.269809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5733ff-a0be-4135-9bb1-1dd2b15981fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:49.273898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdafd5-770d-4f78-a604-c5d50be1c6d2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:49.276945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-4f5733ff-a0be-4135-9bb1-1dd2b15981fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 14:05:49.278362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 156/301] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:49.281802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5733ff-a0be-4135-9bb1-1dd2b15981fd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:49.308792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c03a0-da3b-45a1-8efd-e81a67ac23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:49.309612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c03a0-da3b-45a1-8efd-e81a67ac23d1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.309890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c03a0-da3b-45a1-8efd-e81a67ac23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.310164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c03a0-da3b-45a1-8efd-e81a67ac23d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.320455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c03a0-da3b-45a1-8efd-e81a67ac23d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:49.327591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-0c5c03a0-da3b-45a1-8efd-e81a67ac23d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:49.328995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 146/302] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:49.329571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c03a0-da3b-45a1-8efd-e81a67ac23d1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:49.388407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5733ff-a0be-4135-9bb1-1dd2b15981fd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:49.421746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af6358-a9ac-4885-853d-d1b1f385465b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:49.422528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af6358-a9ac-4885-853d-d1b1f385465b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.422816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af6358-a9ac-4885-853d-d1b1f385465b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.423080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af6358-a9ac-4885-853d-d1b1f385465b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.424280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af6358-a9ac-4885-853d-d1b1f385465b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:49.425714 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af6358-a9ac-4885-853d-d1b1f385465b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:49.432083 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 157/303] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:49.432083 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af6358-a9ac-4885-853d-d1b1f385465b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:49.432286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c03a0-da3b-45a1-8efd-e81a67ac23d1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:49.462283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0b9fb-7b43-4f8a-baa2-8ea5565a04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:49.462947 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0b9fb-7b43-4f8a-baa2-8ea5565a04f6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.463294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0b9fb-7b43-4f8a-baa2-8ea5565a04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.463575 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0b9fb-7b43-4f8a-baa2-8ea5565a04f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.464319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0b9fb-7b43-4f8a-baa2-8ea5565a04f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:49.464625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0b9fb-7b43-4f8a-baa2-8ea5565a04f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:49.466029 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0b9fb-7b43-4f8a-baa2-8ea5565a04f6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:49.473878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 147/304] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:49.475214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0b9fb-7b43-4f8a-baa2-8ea5565a04f6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:49.535428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af6358-a9ac-4885-853d-d1b1f385465b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:49.568887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d7587-39d4-47e3-b88a-a9e5b8fbf241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:49.569141 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0b9fb-7b43-4f8a-baa2-8ea5565a04f6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:49.569617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d7587-39d4-47e3-b88a-a9e5b8fbf241 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.569906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d7587-39d4-47e3-b88a-a9e5b8fbf241 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.570185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d7587-39d4-47e3-b88a-a9e5b8fbf241 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.570927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d7587-39d4-47e3-b88a-a9e5b8fbf241 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:49.571242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d7587-39d4-47e3-b88a-a9e5b8fbf241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:49.572879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d7587-39d4-47e3-b88a-a9e5b8fbf241 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:49.586913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 158/305] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:49.586913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d7587-39d4-47e3-b88a-a9e5b8fbf241 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:49.607540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1156bf-0430-40db-9c0a-6114c4920a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:49.608425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1156bf-0430-40db-9c0a-6114c4920a2d None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.608886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1156bf-0430-40db-9c0a-6114c4920a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.609202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1156bf-0430-40db-9c0a-6114c4920a2d None admin] PATH_INFO: `/v3/groups` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.609889 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1156bf-0430-40db-9c0a-6114c4920a2d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:49.611319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1156bf-0430-40db-9c0a-6114c4920a2d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:49.663595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 148/306] 10.222.0.61 () {60 vars in 1134 bytes} [Tue Apr 12 14:05:49 2022] POST /identity/v3/groups => generated 229 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:49.663595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1156bf-0430-40db-9c0a-6114c4920a2d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:49.706319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d7587-39d4-47e3-b88a-a9e5b8fbf241 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:49.752759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08ac38-3853-4904-bf7f-f07484bcf4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:49.753956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08ac38-3853-4904-bf7f-f07484bcf4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.753956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08ac38-3853-4904-bf7f-f07484bcf4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.754246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08ac38-3853-4904-bf7f-f07484bcf4b1 None admin] PATH_INFO: `/v3/users/b35e21def7d3414fa507717bc6ff8443` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.771084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08ac38-3853-4904-bf7f-f07484bcf4b1 None admin] RBAC: Authorizing `identity:get_user(user_id=b35e21def7d3414fa507717bc6ff8443)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:49.772745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08ac38-3853-4904-bf7f-f07484bcf4b1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:49.774545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 159/307] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:49 2022] GET /identity/v3/users/b35e21def7d3414fa507717bc6ff8443 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:49.778981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833acacb-05fb-489f-9e33-3627beb52202 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.778981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833acacb-05fb-489f-9e33-3627beb52202 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.778981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833acacb-05fb-489f-9e33-3627beb52202 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.778981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 160/308] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:49.782423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1156bf-0430-40db-9c0a-6114c4920a2d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:49.782577 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833acacb-05fb-489f-9e33-3627beb52202 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:49.817864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc77541-c569-4976-989c-6553516721a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:49.819288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc77541-c569-4976-989c-6553516721a9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.819683 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc77541-c569-4976-989c-6553516721a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.819958 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc77541-c569-4976-989c-6553516721a9 None admin] PATH_INFO: `/v3/users/985430dc98a74344bffe5ca5d8f0adb7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.821310 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc77541-c569-4976-989c-6553516721a9 None admin] RBAC: Authorizing `identity:get_user(user_id=985430dc98a74344bffe5ca5d8f0adb7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:49.823042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc77541-c569-4976-989c-6553516721a9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:49.824720 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 149/309] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:49 2022] GET /identity/v3/users/985430dc98a74344bffe5ca5d8f0adb7 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:49.825992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd323-6ae2-4f9f-b0b7-75f2f5927963 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.826277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd323-6ae2-4f9f-b0b7-75f2f5927963 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.826553 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd323-6ae2-4f9f-b0b7-75f2f5927963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.844450 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-248cd323-6ae2-4f9f-b0b7-75f2f5927963 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:49.845689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-248cd323-6ae2-4f9f-b0b7-75f2f5927963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:49.895623 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833acacb-05fb-489f-9e33-3627beb52202 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:49.921597 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 150/310] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:49.922709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cd323-6ae2-4f9f-b0b7-75f2f5927963 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:49.932465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88326076-70c7-4497-9dfc-51fbbd3b829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:49.933392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326076-70c7-4497-9dfc-51fbbd3b829c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:49.933856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326076-70c7-4497-9dfc-51fbbd3b829c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:49.934306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326076-70c7-4497-9dfc-51fbbd3b829c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:49.935332 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88326076-70c7-4497-9dfc-51fbbd3b829c None admin] RBAC: Adding query filter params (role.id=a0d8f7cc5da940d1a33a8d08b79f833b, user.id=b35e21def7d3414fa507717bc6ff8443, scope.system=all) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:49.935790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88326076-70c7-4497-9dfc-51fbbd3b829c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:49.937395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88326076-70c7-4497-9dfc-51fbbd3b829c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:49.949135 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 161/311] 10.222.0.61 () {56 vars in 1308 bytes} [Tue Apr 12 14:05:49 2022] GET /identity/v3/role_assignments?user.id=b35e21def7d3414fa507717bc6ff8443&scope.system=all&role.id=a0d8f7cc5da940d1a33a8d08b79f833b => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:49.951414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88326076-70c7-4497-9dfc-51fbbd3b829c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:50.044123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cd323-6ae2-4f9f-b0b7-75f2f5927963 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:50.065007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88326076-70c7-4497-9dfc-51fbbd3b829c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:50.083564 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae419d1-7673-4201-8d2d-90a77e6d434d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:50.085396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae419d1-7673-4201-8d2d-90a77e6d434d None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:50.085918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae419d1-7673-4201-8d2d-90a77e6d434d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:50.086388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae419d1-7673-4201-8d2d-90a77e6d434d None admin] PATH_INFO: `/v3/system/users/985430dc98a74344bffe5ca5d8f0adb7/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:50.088235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae419d1-7673-4201-8d2d-90a77e6d434d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=985430dc98a74344bffe5ca5d8f0adb7, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:50.089935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae419d1-7673-4201-8d2d-90a77e6d434d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:50.104568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cc5fc-b0c4-4095-aee6-4694b174b321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:50.105406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc5fc-b0c4-4095-aee6-4694b174b321 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:50.105687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc5fc-b0c4-4095-aee6-4694b174b321 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:50.105954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc5fc-b0c4-4095-aee6-4694b174b321 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:50.118467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cc5fc-b0c4-4095-aee6-4694b174b321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:50.125494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-0f3cc5fc-b0c4-4095-aee6-4694b174b321 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 14:05:50.126908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 162/312] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:50.133409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cc5fc-b0c4-4095-aee6-4694b174b321 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:50.166325 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 151/313] 10.222.0.61 () {58 vars in 1334 bytes} [Tue Apr 12 14:05:49 2022] PUT /identity/v3/system/users/985430dc98a74344bffe5ca5d8f0adb7/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:05:50.373264 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cc5fc-b0c4-4095-aee6-4694b174b321 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:50.414642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc930d71-8860-428b-81a9-d842e33d57dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:50.415314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930d71-8860-428b-81a9-d842e33d57dd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:50.415593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930d71-8860-428b-81a9-d842e33d57dd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:50.415864 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930d71-8860-428b-81a9-d842e33d57dd None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:50.416600 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc930d71-8860-428b-81a9-d842e33d57dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:50.416901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc930d71-8860-428b-81a9-d842e33d57dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:50.418309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc930d71-8860-428b-81a9-d842e33d57dd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:50.426576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 163/314] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:50.432976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae419d1-7673-4201-8d2d-90a77e6d434d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:50.538496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae419d1-7673-4201-8d2d-90a77e6d434d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:50.573393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734836e-d9ca-4135-9c5b-81f282192835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:50.574590 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734836e-d9ca-4135-9c5b-81f282192835 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:50.575044 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734836e-d9ca-4135-9c5b-81f282192835 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:50.575484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734836e-d9ca-4135-9c5b-81f282192835 None admin] PATH_INFO: `/v3/users/290f0f6a7b92413c82a0eec967847d33` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:50.576851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734836e-d9ca-4135-9c5b-81f282192835 None admin] RBAC: Authorizing `identity:get_user(user_id=290f0f6a7b92413c82a0eec967847d33)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:50.578476 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734836e-d9ca-4135-9c5b-81f282192835 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:50.580569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 152/315] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:50 2022] GET /identity/v3/users/290f0f6a7b92413c82a0eec967847d33 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:50.587081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc930d71-8860-428b-81a9-d842e33d57dd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:50.691068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc930d71-8860-428b-81a9-d842e33d57dd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:50.724876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66be06a-7923-43cf-8df2-074a352edc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:50.725643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66be06a-7923-43cf-8df2-074a352edc7d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:50.725925 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66be06a-7923-43cf-8df2-074a352edc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:50.726199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66be06a-7923-43cf-8df2-074a352edc7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:50.797073 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66be06a-7923-43cf-8df2-074a352edc7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:50.798518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66be06a-7923-43cf-8df2-074a352edc7d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:50.902710 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 164/316] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:50.908068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734836e-d9ca-4135-9c5b-81f282192835 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:51.010486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734836e-d9ca-4135-9c5b-81f282192835 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:51.044149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef9427-0b87-4b9d-9ea1-3998ca79fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:51.045025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9427-0b87-4b9d-9ea1-3998ca79fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:51.045306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9427-0b87-4b9d-9ea1-3998ca79fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:51.045573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9427-0b87-4b9d-9ea1-3998ca79fbe2 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:51.046907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef9427-0b87-4b9d-9ea1-3998ca79fbe2 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:51.048420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef9427-0b87-4b9d-9ea1-3998ca79fbe2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:51.050502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 153/317] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:50 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:51.056774 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66be06a-7923-43cf-8df2-074a352edc7d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:51.158777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66be06a-7923-43cf-8df2-074a352edc7d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:51.200615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b71b0b-c1c8-488b-bf86-b330d32e929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:51.201300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b71b0b-c1c8-488b-bf86-b330d32e929b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:51.201584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b71b0b-c1c8-488b-bf86-b330d32e929b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:51.201857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b71b0b-c1c8-488b-bf86-b330d32e929b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:51.202682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b71b0b-c1c8-488b-bf86-b330d32e929b None admin] RBAC: Adding query filter params (role.id=a0d8f7cc5da940d1a33a8d08b79f833b, scope.project.id=67f9fe5832664d93a19363ec71de67b0, user.id=290f0f6a7b92413c82a0eec967847d33) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:51.202998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b71b0b-c1c8-488b-bf86-b330d32e929b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:51.204412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b71b0b-c1c8-488b-bf86-b330d32e929b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:51.210558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 165/318] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:05:51 2022] GET /identity/v3/role_assignments?user.id=290f0f6a7b92413c82a0eec967847d33&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=a0d8f7cc5da940d1a33a8d08b79f833b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:52.028191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fdb2d-de94-4fbb-a169-14e8b48125a1 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.028191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fdb2d-de94-4fbb-a169-14e8b48125a1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.028191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fdb2d-de94-4fbb-a169-14e8b48125a1 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.028191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 154/319] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:52.030541 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c0c47-acd5-4b1c-b8b9-1f89a8e81729 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.030854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c0c47-acd5-4b1c-b8b9-1f89a8e81729 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.031130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c0c47-acd5-4b1c-b8b9-1f89a8e81729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.047298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d91c0c47-acd5-4b1c-b8b9-1f89a8e81729 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:52.048549 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d91c0c47-acd5-4b1c-b8b9-1f89a8e81729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:52.113694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 166/320] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:52.137882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fdb2d-de94-4fbb-a169-14e8b48125a1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:52.241311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fdb2d-de94-4fbb-a169-14e8b48125a1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:52.275242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb07264-4e68-493b-800b-54ab129651b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:52.276033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb07264-4e68-493b-800b-54ab129651b0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.276307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb07264-4e68-493b-800b-54ab129651b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.276578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb07264-4e68-493b-800b-54ab129651b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.277758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb07264-4e68-493b-800b-54ab129651b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:52.279388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb07264-4e68-493b-800b-54ab129651b0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:52.281134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 155/321] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:05:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:52.286430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c0c47-acd5-4b1c-b8b9-1f89a8e81729 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:52.344291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678f064-1493-4b6f-b0dd-870034d1ca56 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.344631 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678f064-1493-4b6f-b0dd-870034d1ca56 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.344851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678f064-1493-4b6f-b0dd-870034d1ca56 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.346293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 156/322] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:52.351382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853edb1-6707-4b76-94e0-726e1eb5f06d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.351668 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853edb1-6707-4b76-94e0-726e1eb5f06d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.351997 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853edb1-6707-4b76-94e0-726e1eb5f06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.367850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8853edb1-6707-4b76-94e0-726e1eb5f06d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:52.369047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8853edb1-6707-4b76-94e0-726e1eb5f06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:52.405523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c0c47-acd5-4b1c-b8b9-1f89a8e81729 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:52.438499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28230b-7f33-4027-a6a9-6be847532b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:52.439171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28230b-7f33-4027-a6a9-6be847532b70 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.439450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28230b-7f33-4027-a6a9-6be847532b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.439718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28230b-7f33-4027-a6a9-6be847532b70 None admin] PATH_INFO: `/v3/groups` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.440411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28230b-7f33-4027-a6a9-6be847532b70 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:52.441850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28230b-7f33-4027-a6a9-6be847532b70 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:52.445241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 157/323] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:52.456153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853edb1-6707-4b76-94e0-726e1eb5f06d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:52.550608 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853edb1-6707-4b76-94e0-726e1eb5f06d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:52.564318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 167/324] 10.222.0.61 () {60 vars in 1134 bytes} [Tue Apr 12 14:05:52 2022] POST /identity/v3/groups => generated 226 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:05:52.589026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b711a0-a8bd-46c6-8ca7-13a8f089a42d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.589241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606761d5-a200-4c5e-8633-3beb49c219f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:52.589350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b711a0-a8bd-46c6-8ca7-13a8f089a42d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.589600 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b711a0-a8bd-46c6-8ca7-13a8f089a42d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.589929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606761d5-a200-4c5e-8633-3beb49c219f3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.590207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606761d5-a200-4c5e-8633-3beb49c219f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.590478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606761d5-a200-4c5e-8633-3beb49c219f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.591015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 168/325] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:05:52.597316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51181c64-f033-4ecb-9733-71e217a18f87 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.597618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51181c64-f033-4ecb-9733-71e217a18f87 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.597883 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51181c64-f033-4ecb-9733-71e217a18f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.604350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606761d5-a200-4c5e-8633-3beb49c219f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:52.611910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-606761d5-a200-4c5e-8633-3beb49c219f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 14:05:52.613200 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 158/326] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:52.617037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-51181c64-f033-4ecb-9733-71e217a18f87 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:52.618569 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-51181c64-f033-4ecb-9733-71e217a18f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:52.620418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606761d5-a200-4c5e-8633-3beb49c219f3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:52.696381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 169/327] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:52.721381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51181c64-f033-4ecb-9733-71e217a18f87 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:52.728608 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606761d5-a200-4c5e-8633-3beb49c219f3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:52.767482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908c3a-e015-4f0c-ab7c-e151ca019e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:52.768207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908c3a-e015-4f0c-ab7c-e151ca019e7e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.768495 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908c3a-e015-4f0c-ab7c-e151ca019e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.768772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908c3a-e015-4f0c-ab7c-e151ca019e7e None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.769599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58908c3a-e015-4f0c-ab7c-e151ca019e7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:52.769910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58908c3a-e015-4f0c-ab7c-e151ca019e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:52.771803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58908c3a-e015-4f0c-ab7c-e151ca019e7e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:52.779582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 159/328] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:52.786393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908c3a-e015-4f0c-ab7c-e151ca019e7e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:52.838021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51181c64-f033-4ecb-9733-71e217a18f87 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:52.878333 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec05a7b-8031-4bc0-bd32-49862225450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:52.879138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05a7b-8031-4bc0-bd32-49862225450d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.879421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05a7b-8031-4bc0-bd32-49862225450d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.879696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05a7b-8031-4bc0-bd32-49862225450d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.891198 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec05a7b-8031-4bc0-bd32-49862225450d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:52.899626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-2ec05a7b-8031-4bc0-bd32-49862225450d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:52.904985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 170/329] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:52.906769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec05a7b-8031-4bc0-bd32-49862225450d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:52.907808 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908c3a-e015-4f0c-ab7c-e151ca019e7e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:52.946934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea5bf4-50f2-4751-8ee4-e5cac469d768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:52.948477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea5bf4-50f2-4751-8ee4-e5cac469d768 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:52.949764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea5bf4-50f2-4751-8ee4-e5cac469d768 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:52.950203 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea5bf4-50f2-4751-8ee4-e5cac469d768 None admin] PATH_INFO: `/v3/users/b35e21def7d3414fa507717bc6ff8443` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:52.951641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea5bf4-50f2-4751-8ee4-e5cac469d768 None admin] RBAC: Authorizing `identity:get_user(user_id=b35e21def7d3414fa507717bc6ff8443)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:52.953275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea5bf4-50f2-4751-8ee4-e5cac469d768 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:52.956210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 160/330] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:52 2022] GET /identity/v3/users/b35e21def7d3414fa507717bc6ff8443 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:52.961831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea5bf4-50f2-4751-8ee4-e5cac469d768 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:53.024563 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec05a7b-8031-4bc0-bd32-49862225450d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:53.065010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1d8c5-0d03-48f7-85fc-626b0ca303c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:53.065010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1d8c5-0d03-48f7-85fc-626b0ca303c5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:53.065010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1d8c5-0d03-48f7-85fc-626b0ca303c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:53.065010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1d8c5-0d03-48f7-85fc-626b0ca303c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:53.065407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1d8c5-0d03-48f7-85fc-626b0ca303c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:53.065407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1d8c5-0d03-48f7-85fc-626b0ca303c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:53.066192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1d8c5-0d03-48f7-85fc-626b0ca303c5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:53.075803 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 171/331] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:53.080632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea5bf4-50f2-4751-8ee4-e5cac469d768 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:53.081873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1d8c5-0d03-48f7-85fc-626b0ca303c5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:53.116640 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7e749-5359-41ef-85ed-e252d69f00b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:53.117476 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e749-5359-41ef-85ed-e252d69f00b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:53.117761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e749-5359-41ef-85ed-e252d69f00b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:53.118080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e749-5359-41ef-85ed-e252d69f00b1 None admin] PATH_INFO: `/v3/system/users/b35e21def7d3414fa507717bc6ff8443/roles/a0d8f7cc5da940d1a33a8d08b79f833b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:53.119618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7e749-5359-41ef-85ed-e252d69f00b1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b35e21def7d3414fa507717bc6ff8443, role_id=a0d8f7cc5da940d1a33a8d08b79f833b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:53.121110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7e749-5359-41ef-85ed-e252d69f00b1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:53.187428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1d8c5-0d03-48f7-85fc-626b0ca303c5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:53.188936 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 161/332] 10.222.0.61 () {58 vars in 1334 bytes} [Tue Apr 12 14:05:52 2022] PUT /identity/v3/system/users/b35e21def7d3414fa507717bc6ff8443/roles/a0d8f7cc5da940d1a33a8d08b79f833b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:05:53.227236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328e6d2-b6d8-4b3e-a194-ecb00758d7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:53.228517 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328e6d2-b6d8-4b3e-a194-ecb00758d7fd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:53.229015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328e6d2-b6d8-4b3e-a194-ecb00758d7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:53.229475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328e6d2-b6d8-4b3e-a194-ecb00758d7fd None admin] PATH_INFO: `/v3/users/985430dc98a74344bffe5ca5d8f0adb7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:53.230961 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328e6d2-b6d8-4b3e-a194-ecb00758d7fd None admin] RBAC: Authorizing `identity:get_user(user_id=985430dc98a74344bffe5ca5d8f0adb7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:53.232642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328e6d2-b6d8-4b3e-a194-ecb00758d7fd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:53.235044 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 172/333] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:53 2022] GET /identity/v3/users/985430dc98a74344bffe5ca5d8f0adb7 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:53.240813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7e749-5359-41ef-85ed-e252d69f00b1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:53.378672 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7e749-5359-41ef-85ed-e252d69f00b1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:53.416201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df22c9f-2700-4e54-9978-323345faa257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:53.416865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df22c9f-2700-4e54-9978-323345faa257 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:53.417177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df22c9f-2700-4e54-9978-323345faa257 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:53.417457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df22c9f-2700-4e54-9978-323345faa257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:53.418298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df22c9f-2700-4e54-9978-323345faa257 None admin] RBAC: Adding query filter params (role.id=a0c62419d02f426ea41c7faf22b2bf8a, user.id=985430dc98a74344bffe5ca5d8f0adb7, scope.system=all) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:53.418610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df22c9f-2700-4e54-9978-323345faa257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:53.420110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df22c9f-2700-4e54-9978-323345faa257 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:53.437105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 162/334] 10.222.0.61 () {56 vars in 1308 bytes} [Tue Apr 12 14:05:53 2022] GET /identity/v3/role_assignments?user.id=985430dc98a74344bffe5ca5d8f0adb7&scope.system=all&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:55.683615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bcb84-56d2-4e38-b410-0939779387e7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:55.684438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bcb84-56d2-4e38-b410-0939779387e7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:55.684882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bcb84-56d2-4e38-b410-0939779387e7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:55.686407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 173/335] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:55.692118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc6150-bd94-444b-bc18-d0ee859067ad None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:55.693550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc6150-bd94-444b-bc18-d0ee859067ad None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:55.694098 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc6150-bd94-444b-bc18-d0ee859067ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:55.712864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-18bc6150-bd94-444b-bc18-d0ee859067ad None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:55.714675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfd517-419c-43b0-9da7-7cbb8f06758d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:55.715169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfd517-419c-43b0-9da7-7cbb8f06758d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:55.715643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfd517-419c-43b0-9da7-7cbb8f06758d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:55.717534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 174/336] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:55.718315 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-18bc6150-bd94-444b-bc18-d0ee859067ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:55.722827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148fe08-d4b3-4e34-905d-79f65398580a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:55.723347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148fe08-d4b3-4e34-905d-79f65398580a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:55.723856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148fe08-d4b3-4e34-905d-79f65398580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:55.744066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0148fe08-d4b3-4e34-905d-79f65398580a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:55.745641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0148fe08-d4b3-4e34-905d-79f65398580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:55.829001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 175/337] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:55.852927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148fe08-d4b3-4e34-905d-79f65398580a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:55.862782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 163/338] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:55.905411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc6150-bd94-444b-bc18-d0ee859067ad None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:55.960369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148fe08-d4b3-4e34-905d-79f65398580a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:55.995563 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc758277-8e00-4fce-9134-cb6a93608252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:55.996406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758277-8e00-4fce-9134-cb6a93608252 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:55.996700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758277-8e00-4fce-9134-cb6a93608252 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:55.996979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758277-8e00-4fce-9134-cb6a93608252 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.008979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc758277-8e00-4fce-9134-cb6a93608252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:56.016010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-bc758277-8e00-4fce-9134-cb6a93608252 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:56.017312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 176/339] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:56.023611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc758277-8e00-4fce-9134-cb6a93608252 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:56.069518 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc6150-bd94-444b-bc18-d0ee859067ad None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:56.113391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedca89-ffae-4e78-b38d-b883e5e29884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:56.114691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedca89-ffae-4e78-b38d-b883e5e29884 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:56.115188 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedca89-ffae-4e78-b38d-b883e5e29884 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:56.115736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedca89-ffae-4e78-b38d-b883e5e29884 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.126293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc758277-8e00-4fce-9134-cb6a93608252 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:56.126832 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedca89-ffae-4e78-b38d-b883e5e29884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:56.135304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-adedca89-ffae-4e78-b38d-b883e5e29884 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:05:56.141226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 164/340] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:05:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:56.143126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedca89-ffae-4e78-b38d-b883e5e29884 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:56.160535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48584d0c-f96b-4d1c-90ac-fc015ee2fcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:56.161270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48584d0c-f96b-4d1c-90ac-fc015ee2fcfa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:56.161542 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48584d0c-f96b-4d1c-90ac-fc015ee2fcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:56.161810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48584d0c-f96b-4d1c-90ac-fc015ee2fcfa None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.162553 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48584d0c-f96b-4d1c-90ac-fc015ee2fcfa None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:56.162859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48584d0c-f96b-4d1c-90ac-fc015ee2fcfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:56.164482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48584d0c-f96b-4d1c-90ac-fc015ee2fcfa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:56.172913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 177/341] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:56.179658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48584d0c-f96b-4d1c-90ac-fc015ee2fcfa None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:56.258442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedca89-ffae-4e78-b38d-b883e5e29884 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:56.280357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48584d0c-f96b-4d1c-90ac-fc015ee2fcfa None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:56.294563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147df89-2abe-4f67-a160-3d25a7386b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:56.295960 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147df89-2abe-4f67-a160-3d25a7386b49 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:56.296446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147df89-2abe-4f67-a160-3d25a7386b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:56.296938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147df89-2abe-4f67-a160-3d25a7386b49 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.297941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147df89-2abe-4f67-a160-3d25a7386b49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:56.298473 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147df89-2abe-4f67-a160-3d25a7386b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:56.300070 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147df89-2abe-4f67-a160-3d25a7386b49 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:56.314119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 165/342] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:05:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:56.315440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147df89-2abe-4f67-a160-3d25a7386b49 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:56.315743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26088a84-9aff-4f35-b427-34a72e8738d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:56.316687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26088a84-9aff-4f35-b427-34a72e8738d5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:56.317191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26088a84-9aff-4f35-b427-34a72e8738d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:56.317723 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26088a84-9aff-4f35-b427-34a72e8738d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.398251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26088a84-9aff-4f35-b427-34a72e8738d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:56.399989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26088a84-9aff-4f35-b427-34a72e8738d5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:56.431863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147df89-2abe-4f67-a160-3d25a7386b49 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:56.480294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7324e-0466-416d-853f-87918fd46be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:56.480995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7324e-0466-416d-853f-87918fd46be9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:56.481293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7324e-0466-416d-853f-87918fd46be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:56.481573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7324e-0466-416d-853f-87918fd46be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.504753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 178/343] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:56.511599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26088a84-9aff-4f35-b427-34a72e8738d5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:56.579700 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7324e-0466-416d-853f-87918fd46be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:56.581302 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7324e-0466-416d-853f-87918fd46be9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:56.614998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26088a84-9aff-4f35-b427-34a72e8738d5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:56.653275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1ba9c-2ea9-4d75-bafc-656fbf1eb827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:56.654509 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1ba9c-2ea9-4d75-bafc-656fbf1eb827 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:56.654978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1ba9c-2ea9-4d75-bafc-656fbf1eb827 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:56.655436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1ba9c-2ea9-4d75-bafc-656fbf1eb827 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.656828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1ba9c-2ea9-4d75-bafc-656fbf1eb827 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:56.658499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1ba9c-2ea9-4d75-bafc-656fbf1eb827 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:56.675057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 179/344] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:56 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:56.677897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1ba9c-2ea9-4d75-bafc-656fbf1eb827 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:56.712661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 166/345] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:56.722354 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7324e-0466-416d-853f-87918fd46be9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:56.782597 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1ba9c-2ea9-4d75-bafc-656fbf1eb827 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:56.820362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ae949-fe00-43bd-9589-2abc62f157aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:56.821604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae949-fe00-43bd-9589-2abc62f157aa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:56.822081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae949-fe00-43bd-9589-2abc62f157aa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:56.822821 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae949-fe00-43bd-9589-2abc62f157aa None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.829357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ae949-fe00-43bd-9589-2abc62f157aa None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:56.831089 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ae949-fe00-43bd-9589-2abc62f157aa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:56.833378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 180/346] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:05:56 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:56.835050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea592b3c-ea44-404c-8654-e19bd18d8dcd None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:56.835550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea592b3c-ea44-404c-8654-e19bd18d8dcd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:56.836023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea592b3c-ea44-404c-8654-e19bd18d8dcd None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.841659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 181/347] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:56.843536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea592b3c-ea44-404c-8654-e19bd18d8dcd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:56.865567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7324e-0466-416d-853f-87918fd46be9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:56.910980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6a665-0651-4f6b-bb80-9395d7aad358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:56.912017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a665-0651-4f6b-bb80-9395d7aad358 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:56.912300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a665-0651-4f6b-bb80-9395d7aad358 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:56.912577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a665-0651-4f6b-bb80-9395d7aad358 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.913930 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6a665-0651-4f6b-bb80-9395d7aad358 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:56.915479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6a665-0651-4f6b-bb80-9395d7aad358 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:56.922100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 167/348] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:56 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:56.923511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97604a1-df5c-4e49-aede-2a8351afab93 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:56.923802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97604a1-df5c-4e49-aede-2a8351afab93 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:56.924133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97604a1-df5c-4e49-aede-2a8351afab93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.947736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c97604a1-df5c-4e49-aede-2a8351afab93 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:56.949901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c97604a1-df5c-4e49-aede-2a8351afab93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:56.954989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea592b3c-ea44-404c-8654-e19bd18d8dcd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:56.989595 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29e18f-c53b-4fb4-a4a8-bbd2cbc5992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:56.990615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29e18f-c53b-4fb4-a4a8-bbd2cbc5992d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:56.991116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29e18f-c53b-4fb4-a4a8-bbd2cbc5992d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:56.991588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29e18f-c53b-4fb4-a4a8-bbd2cbc5992d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:56.992605 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29e18f-c53b-4fb4-a4a8-bbd2cbc5992d None admin] RBAC: Adding query filter params (group.id=e51653a16b524006a76e2161c35edf49, role.id=a0c62419d02f426ea41c7faf22b2bf8a, scope.project.id=658d1c3291ff49e386ba21e2afa82144) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:56.993142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29e18f-c53b-4fb4-a4a8-bbd2cbc5992d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:56.994752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29e18f-c53b-4fb4-a4a8-bbd2cbc5992d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:57.005834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 182/349] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Apr 12 14:05:56 2022] GET /identity/v3/role_assignments?group.id=e51653a16b524006a76e2161c35edf49&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:57.007081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29e18f-c53b-4fb4-a4a8-bbd2cbc5992d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:57.035803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 168/350] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:57.062182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97604a1-df5c-4e49-aede-2a8351afab93 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:57.199175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97604a1-df5c-4e49-aede-2a8351afab93 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:57.200702 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29e18f-c53b-4fb4-a4a8-bbd2cbc5992d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:57.244230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c391fc7-7aaf-498f-9469-e05a89af5977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:57.245079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c391fc7-7aaf-498f-9469-e05a89af5977 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:57.245355 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c391fc7-7aaf-498f-9469-e05a89af5977 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:57.245635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c391fc7-7aaf-498f-9469-e05a89af5977 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:57.262527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c391fc7-7aaf-498f-9469-e05a89af5977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:57.274148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-9c391fc7-7aaf-498f-9469-e05a89af5977 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 14:05:57.278824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 169/351] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:57.281418 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c66e9-d022-4f4a-b7e2-4d9f501111cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:57.281610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c391fc7-7aaf-498f-9469-e05a89af5977 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:57.282333 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c66e9-d022-4f4a-b7e2-4d9f501111cf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:57.282627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c66e9-d022-4f4a-b7e2-4d9f501111cf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:57.282908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c66e9-d022-4f4a-b7e2-4d9f501111cf None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:57.284238 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c66e9-d022-4f4a-b7e2-4d9f501111cf None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:57.285737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c66e9-d022-4f4a-b7e2-4d9f501111cf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:57.287925 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 183/352] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:05:57 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:57.293758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c66e9-d022-4f4a-b7e2-4d9f501111cf None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:57.397236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c391fc7-7aaf-498f-9469-e05a89af5977 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:57.441857 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40763674-132b-4e74-a770-d09052429de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:57.443137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763674-132b-4e74-a770-d09052429de7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:57.443427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763674-132b-4e74-a770-d09052429de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:57.443707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763674-132b-4e74-a770-d09052429de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:57.444503 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40763674-132b-4e74-a770-d09052429de7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:57.444817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40763674-132b-4e74-a770-d09052429de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:57.446342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40763674-132b-4e74-a770-d09052429de7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:57.456479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 170/353] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:57.458017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a42e5b-14e5-4e29-9200-ea162f0b6c8c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:57.458314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a42e5b-14e5-4e29-9200-ea162f0b6c8c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:57.458594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a42e5b-14e5-4e29-9200-ea162f0b6c8c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:57.459877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 171/354] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:57.464872 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a42e5b-14e5-4e29-9200-ea162f0b6c8c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:57.508902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c66e9-d022-4f4a-b7e2-4d9f501111cf None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:57.581703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5b14f-60a1-4522-b85e-b8f2d1a083e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:57.582295 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b14f-60a1-4522-b85e-b8f2d1a083e8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:57.582580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b14f-60a1-4522-b85e-b8f2d1a083e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:57.582859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b14f-60a1-4522-b85e-b8f2d1a083e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:57.583744 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5b14f-60a1-4522-b85e-b8f2d1a083e8 None admin] RBAC: Adding query filter params (group.id=e51653a16b524006a76e2161c35edf49, role.id=b227940c19244df2b57662537283a467, scope.project.id=658d1c3291ff49e386ba21e2afa82144) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:57.584056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5b14f-60a1-4522-b85e-b8f2d1a083e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:57.585534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5b14f-60a1-4522-b85e-b8f2d1a083e8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:57.597248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 184/355] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Apr 12 14:05:57 2022] GET /identity/v3/role_assignments?group.id=e51653a16b524006a76e2161c35edf49&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=b227940c19244df2b57662537283a467 => generated 260 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:57.599988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42c7c8-cc4b-493b-8169-ce5a952b50af None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:57.600321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42c7c8-cc4b-493b-8169-ce5a952b50af None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:57.604393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42c7c8-cc4b-493b-8169-ce5a952b50af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:57.641495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6d42c7c8-cc4b-493b-8169-ce5a952b50af None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:57.642771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6d42c7c8-cc4b-493b-8169-ce5a952b50af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:57.645053 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a42e5b-14e5-4e29-9200-ea162f0b6c8c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:57.698073 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9adc0-1453-4738-80c9-b22cec866489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:57.698983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9adc0-1453-4738-80c9-b22cec866489 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:57.699273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9adc0-1453-4738-80c9-b22cec866489 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:57.699546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9adc0-1453-4738-80c9-b22cec866489 None admin] PATH_INFO: `/v3/users/b35e21def7d3414fa507717bc6ff8443` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:57.700916 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9adc0-1453-4738-80c9-b22cec866489 None admin] RBAC: Authorizing `identity:get_user(user_id=b35e21def7d3414fa507717bc6ff8443)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:57.702436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9adc0-1453-4738-80c9-b22cec866489 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:57.704523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 172/356] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:05:57 2022] GET /identity/v3/users/b35e21def7d3414fa507717bc6ff8443 => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:57.710494 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9adc0-1453-4738-80c9-b22cec866489 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:57.791757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 185/357] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:57.836747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42c7c8-cc4b-493b-8169-ce5a952b50af None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:57.862251 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9adc0-1453-4738-80c9-b22cec866489 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:57.901628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc4aab-cd07-434d-ac88-fdf3ff17ba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:57.902292 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc4aab-cd07-434d-ac88-fdf3ff17ba5b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:57.902573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc4aab-cd07-434d-ac88-fdf3ff17ba5b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:57.902849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc4aab-cd07-434d-ac88-fdf3ff17ba5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:57.903689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc4aab-cd07-434d-ac88-fdf3ff17ba5b None admin] RBAC: Adding query filter params (role.id=a0d8f7cc5da940d1a33a8d08b79f833b, user.id=b35e21def7d3414fa507717bc6ff8443, scope.system=all) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:57.904004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc4aab-cd07-434d-ac88-fdf3ff17ba5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:57.905480 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc4aab-cd07-434d-ac88-fdf3ff17ba5b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:57.928680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 173/358] 10.222.0.61 () {56 vars in 1308 bytes} [Tue Apr 12 14:05:57 2022] GET /identity/v3/role_assignments?user.id=b35e21def7d3414fa507717bc6ff8443&scope.system=all&role.id=a0d8f7cc5da940d1a33a8d08b79f833b => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:57.996395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42c7c8-cc4b-493b-8169-ce5a952b50af None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:58.039188 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac37b51-99ac-4f8a-802f-87bbc513c7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:58.040017 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac37b51-99ac-4f8a-802f-87bbc513c7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.040299 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac37b51-99ac-4f8a-802f-87bbc513c7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.040571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac37b51-99ac-4f8a-802f-87bbc513c7e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.059420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac37b51-99ac-4f8a-802f-87bbc513c7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:58.066980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-8ac37b51-99ac-4f8a-802f-87bbc513c7e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:05:58.069322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 186/359] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:05:58.075542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc4aab-cd07-434d-ac88-fdf3ff17ba5b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:58.125212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9187e0-9e6c-4bf5-85fb-5db1f775705a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.125399 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9187e0-9e6c-4bf5-85fb-5db1f775705a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.125686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9187e0-9e6c-4bf5-85fb-5db1f775705a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.127110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 187/360] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:58.133158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266ade-fac7-4fec-b5a9-65db4273be00 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.133783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266ade-fac7-4fec-b5a9-65db4273be00 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.134260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266ade-fac7-4fec-b5a9-65db4273be00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.162563 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e6266ade-fac7-4fec-b5a9-65db4273be00 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:58.163756 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e6266ade-fac7-4fec-b5a9-65db4273be00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:58.204913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc4aab-cd07-434d-ac88-fdf3ff17ba5b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:58.238923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 188/361] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:05:58.241381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5131-3335-4b53-90f0-aa3e6aa613e0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.241831 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5131-3335-4b53-90f0-aa3e6aa613e0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.241943 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999496a-7e9b-4621-98db-ad570d9d41d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:58.242376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5131-3335-4b53-90f0-aa3e6aa613e0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.242800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999496a-7e9b-4621-98db-ad570d9d41d1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.243177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999496a-7e9b-4621-98db-ad570d9d41d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.243546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999496a-7e9b-4621-98db-ad570d9d41d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.244414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999496a-7e9b-4621-98db-ad570d9d41d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:58.244696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 189/362] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:05:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:05:58.249007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999496a-7e9b-4621-98db-ad570d9d41d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:58.249007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999496a-7e9b-4621-98db-ad570d9d41d1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:58.251149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1709-70c0-4ce5-b8c9-3540c0577d41 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.251590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1709-70c0-4ce5-b8c9-3540c0577d41 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.252009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1709-70c0-4ce5-b8c9-3540c0577d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.258307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 174/363] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:05:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:58.264611 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999496a-7e9b-4621-98db-ad570d9d41d1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:58.271138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-01da1709-70c0-4ce5-b8c9-3540c0577d41 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:05:58.274427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-01da1709-70c0-4ce5-b8c9-3540c0577d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:05:58.373068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 190/364] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:05:58.373972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1709-70c0-4ce5-b8c9-3540c0577d41 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:58.413424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999496a-7e9b-4621-98db-ad570d9d41d1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:58.453468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d067e3f-db20-426d-9232-e4ae51a1d2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:58.454309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d067e3f-db20-426d-9232-e4ae51a1d2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.454431 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d067e3f-db20-426d-9232-e4ae51a1d2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.454682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d067e3f-db20-426d-9232-e4ae51a1d2b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.497310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1709-70c0-4ce5-b8c9-3540c0577d41 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:58.533289 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d067e3f-db20-426d-9232-e4ae51a1d2b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:58.535765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d067e3f-db20-426d-9232-e4ae51a1d2b6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:58.539973 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecc1cc-1dba-4c91-bf2a-744b55ac5e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:58.541128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecc1cc-1dba-4c91-bf2a-744b55ac5e78 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.541618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecc1cc-1dba-4c91-bf2a-744b55ac5e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.542088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecc1cc-1dba-4c91-bf2a-744b55ac5e78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.553583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecc1cc-1dba-4c91-bf2a-744b55ac5e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:58.561714 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-75ecc1cc-1dba-4c91-bf2a-744b55ac5e78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:05:58.563219 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 191/365] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:05:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:58.564398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecc1cc-1dba-4c91-bf2a-744b55ac5e78 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:58.646792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 175/366] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:58.648035 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d067e3f-db20-426d-9232-e4ae51a1d2b6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:58.683214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecc1cc-1dba-4c91-bf2a-744b55ac5e78 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:58.718714 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c8cb7-479c-4548-baeb-cc8deb081d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:58.719902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c8cb7-479c-4548-baeb-cc8deb081d20 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.720386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c8cb7-479c-4548-baeb-cc8deb081d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.720912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c8cb7-479c-4548-baeb-cc8deb081d20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.733444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c8cb7-479c-4548-baeb-cc8deb081d20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:05:58.742276 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-142c8cb7-479c-4548-baeb-cc8deb081d20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:05:58.743867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 192/367] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:05:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:05:58.749506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c8cb7-479c-4548-baeb-cc8deb081d20 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:58.766840 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d067e3f-db20-426d-9232-e4ae51a1d2b6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:58.809798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb60f9-c868-4fa6-ba44-ea8fe701ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:58.810486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb60f9-c868-4fa6-ba44-ea8fe701ed11 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.810771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb60f9-c868-4fa6-ba44-ea8fe701ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.811074 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb60f9-c868-4fa6-ba44-ea8fe701ed11 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.812063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb60f9-c868-4fa6-ba44-ea8fe701ed11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:58.812373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb60f9-c868-4fa6-ba44-ea8fe701ed11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:58.813919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb60f9-c868-4fa6-ba44-ea8fe701ed11 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:58.829819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 176/368] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:05:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:58.831265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb60f9-c868-4fa6-ba44-ea8fe701ed11 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:58.867302 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c8cb7-479c-4548-baeb-cc8deb081d20 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:58.909628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d4606-3579-4b8f-9f71-efca0f897ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:58.910549 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d4606-3579-4b8f-9f71-efca0f897ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.910834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d4606-3579-4b8f-9f71-efca0f897ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.911892 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d4606-3579-4b8f-9f71-efca0f897ce5 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.913623 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d4606-3579-4b8f-9f71-efca0f897ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:58.916142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d4606-3579-4b8f-9f71-efca0f897ce5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:58.922405 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 193/369] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:58 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:58.922405 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d4606-3579-4b8f-9f71-efca0f897ce5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:58.952607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb60f9-c868-4fa6-ba44-ea8fe701ed11 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:58.989233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae1627-9bf5-4296-bf1c-9a4c26e474d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:58.990278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae1627-9bf5-4296-bf1c-9a4c26e474d8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:58.990780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae1627-9bf5-4296-bf1c-9a4c26e474d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:58.991253 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae1627-9bf5-4296-bf1c-9a4c26e474d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:58.992197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae1627-9bf5-4296-bf1c-9a4c26e474d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:58.992716 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae1627-9bf5-4296-bf1c-9a4c26e474d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:58.994434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae1627-9bf5-4296-bf1c-9a4c26e474d8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:59.006678 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 177/370] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:05:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:59.007862 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae1627-9bf5-4296-bf1c-9a4c26e474d8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:59.024885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d4606-3579-4b8f-9f71-efca0f897ce5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:59.058632 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c2686-894f-411a-af08-d279a1334d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:59.059501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c2686-894f-411a-af08-d279a1334d6a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:59.059625 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c2686-894f-411a-af08-d279a1334d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:59.059830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c2686-894f-411a-af08-d279a1334d6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:59.116804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae1627-9bf5-4296-bf1c-9a4c26e474d8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:59.131822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c2686-894f-411a-af08-d279a1334d6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:59.133655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c2686-894f-411a-af08-d279a1334d6a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:59.154502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08b822-47be-49f6-ad60-09caebeabd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:59.155753 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b822-47be-49f6-ad60-09caebeabd96 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:59.156274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b822-47be-49f6-ad60-09caebeabd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:59.156768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b822-47be-49f6-ad60-09caebeabd96 None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:59.158240 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08b822-47be-49f6-ad60-09caebeabd96 None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:59.159950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08b822-47be-49f6-ad60-09caebeabd96 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:59.166850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 178/371] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:05:59 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:59.167956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08b822-47be-49f6-ad60-09caebeabd96 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:59.235498 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 194/372] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:59.236072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c2686-894f-411a-af08-d279a1334d6a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:59.271806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08b822-47be-49f6-ad60-09caebeabd96 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:59.308179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c35f7d-0bd2-4351-be04-b1a9affadb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:59.309222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c35f7d-0bd2-4351-be04-b1a9affadb80 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:59.309731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c35f7d-0bd2-4351-be04-b1a9affadb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:59.310207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c35f7d-0bd2-4351-be04-b1a9affadb80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:59.334650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c2686-894f-411a-af08-d279a1334d6a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:59.368176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241623c3-6def-4bbe-bdc9-76d51ad4b784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:59.368848 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241623c3-6def-4bbe-bdc9-76d51ad4b784 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:59.369149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241623c3-6def-4bbe-bdc9-76d51ad4b784 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:59.369422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241623c3-6def-4bbe-bdc9-76d51ad4b784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:59.370257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241623c3-6def-4bbe-bdc9-76d51ad4b784 None admin] RBAC: Adding query filter params (group.id=e51653a16b524006a76e2161c35edf49, role.id=a0c62419d02f426ea41c7faf22b2bf8a, scope.project.id=67f9fe5832664d93a19363ec71de67b0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:05:59.370569 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241623c3-6def-4bbe-bdc9-76d51ad4b784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:59.371992 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241623c3-6def-4bbe-bdc9-76d51ad4b784 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:59.384994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 195/373] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Apr 12 14:05:59 2022] GET /identity/v3/role_assignments?group.id=e51653a16b524006a76e2161c35edf49&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:59.384994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241623c3-6def-4bbe-bdc9-76d51ad4b784 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:59.388369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c35f7d-0bd2-4351-be04-b1a9affadb80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:59.390173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c35f7d-0bd2-4351-be04-b1a9affadb80 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:59.485029 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241623c3-6def-4bbe-bdc9-76d51ad4b784 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:59.519607 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5551c6-4597-4ad8-acff-2651fe7adc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:59.521013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5551c6-4597-4ad8-acff-2651fe7adc6e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:59.521352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5551c6-4597-4ad8-acff-2651fe7adc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:59.521630 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5551c6-4597-4ad8-acff-2651fe7adc6e None admin] PATH_INFO: `/v3/projects/1882ed88f2204017b2d59722788747c1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:59.522946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5551c6-4597-4ad8-acff-2651fe7adc6e None admin] RBAC: Authorizing `identity:get_project(project_id=1882ed88f2204017b2d59722788747c1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:59.524379 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5551c6-4597-4ad8-acff-2651fe7adc6e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:59.526117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 196/374] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:59 2022] GET /identity/v3/projects/1882ed88f2204017b2d59722788747c1 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:59.533212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 179/375] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:05:59.534035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5551c6-4597-4ad8-acff-2651fe7adc6e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:59.536787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c35f7d-0bd2-4351-be04-b1a9affadb80 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:59.727891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5551c6-4597-4ad8-acff-2651fe7adc6e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:59.763126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c35f7d-0bd2-4351-be04-b1a9affadb80 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:05:59.767853 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae3526-e73e-41bf-872b-a6af1acf0acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:59.770000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae3526-e73e-41bf-872b-a6af1acf0acc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:59.770334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae3526-e73e-41bf-872b-a6af1acf0acc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:59.771213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae3526-e73e-41bf-872b-a6af1acf0acc None admin] PATH_INFO: `/v3/groups/eb039789f6c44a728355d1a911d1fda4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:59.778822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae3526-e73e-41bf-872b-a6af1acf0acc None admin] RBAC: Authorizing `identity:get_group(group_id=eb039789f6c44a728355d1a911d1fda4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:59.779429 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae3526-e73e-41bf-872b-a6af1acf0acc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:59.784986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 197/376] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:05:59 2022] GET /identity/v3/groups/eb039789f6c44a728355d1a911d1fda4 => generated 229 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:05:59.791650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae3526-e73e-41bf-872b-a6af1acf0acc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:59.818082 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c993c06-be4f-4390-82bf-ddb6d0354832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:05:59.819258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c993c06-be4f-4390-82bf-ddb6d0354832 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:05:59.819555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c993c06-be4f-4390-82bf-ddb6d0354832 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:05:59.819836 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c993c06-be4f-4390-82bf-ddb6d0354832 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:05:59.825873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c993c06-be4f-4390-82bf-ddb6d0354832 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:05:59.827352 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c993c06-be4f-4390-82bf-ddb6d0354832 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:05:59.829344 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 180/377] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:05:59 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:05:59.835909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c993c06-be4f-4390-82bf-ddb6d0354832 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:05:59.918753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae3526-e73e-41bf-872b-a6af1acf0acc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:00.008100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c993c06-be4f-4390-82bf-ddb6d0354832 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:00.009681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee4c92-d4c3-440a-a313-c7428ea4e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:00.010361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee4c92-d4c3-440a-a313-c7428ea4e4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:00.010660 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee4c92-d4c3-440a-a313-c7428ea4e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:00.010986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee4c92-d4c3-440a-a313-c7428ea4e4d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:00.011776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee4c92-d4c3-440a-a313-c7428ea4e4d1 None admin] RBAC: Adding query filter params (group.id=eb039789f6c44a728355d1a911d1fda4, role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=1882ed88f2204017b2d59722788747c1) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:00.012793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee4c92-d4c3-440a-a313-c7428ea4e4d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:00.013555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee4c92-d4c3-440a-a313-c7428ea4e4d1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:00.031378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 198/378] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Apr 12 14:05:59 2022] GET /identity/v3/role_assignments?group.id=eb039789f6c44a728355d1a911d1fda4&scope.project.id=1882ed88f2204017b2d59722788747c1&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:00.060798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9ff1-880b-418f-b9c7-3214bfbba730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:00.062035 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9ff1-880b-418f-b9c7-3214bfbba730 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:00.062507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9ff1-880b-418f-b9c7-3214bfbba730 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:00.062969 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9ff1-880b-418f-b9c7-3214bfbba730 None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:00.065993 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9ff1-880b-418f-b9c7-3214bfbba730 None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:00.068282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9ff1-880b-418f-b9c7-3214bfbba730 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:00.070554 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 181/379] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:05:59 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:00.076469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee4c92-d4c3-440a-a313-c7428ea4e4d1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:00.236420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee4c92-d4c3-440a-a313-c7428ea4e4d1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:00.282693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf456fb1-4e53-4f57-8170-52582e560d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:00.283294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456fb1-4e53-4f57-8170-52582e560d0a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:00.283579 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456fb1-4e53-4f57-8170-52582e560d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:00.283856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456fb1-4e53-4f57-8170-52582e560d0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:00.284708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf456fb1-4e53-4f57-8170-52582e560d0a None admin] RBAC: Adding query filter params (group.id=e51653a16b524006a76e2161c35edf49, role.id=b227940c19244df2b57662537283a467, scope.project.id=67f9fe5832664d93a19363ec71de67b0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:00.285049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf456fb1-4e53-4f57-8170-52582e560d0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:00.286541 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf456fb1-4e53-4f57-8170-52582e560d0a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:00.298526 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 199/380] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Apr 12 14:06:00 2022] GET /identity/v3/role_assignments?group.id=e51653a16b524006a76e2161c35edf49&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=b227940c19244df2b57662537283a467 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:00.356257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d349-4905-4f0a-a8dc-037d014cb3c0 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:00.356538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d349-4905-4f0a-a8dc-037d014cb3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:00.356824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d349-4905-4f0a-a8dc-037d014cb3c0 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:00.358542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 182/381] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:00.363622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748e49f-1591-4686-a981-b2da00d45737 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:00.363914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748e49f-1591-4686-a981-b2da00d45737 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:00.364229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748e49f-1591-4686-a981-b2da00d45737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:00.382173 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e748e49f-1591-4686-a981-b2da00d45737 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:00.383456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e748e49f-1591-4686-a981-b2da00d45737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:00.471701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 200/382] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:00.505369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936d349-4905-4f0a-a8dc-037d014cb3c0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:00.644004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003a6d-0476-4c67-a9cb-5d1d1e66747b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:00.644323 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003a6d-0476-4c67-a9cb-5d1d1e66747b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:00.644520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003a6d-0476-4c67-a9cb-5d1d1e66747b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:00.646233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 201/383] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:06:00.646511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936d349-4905-4f0a-a8dc-037d014cb3c0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:00.653445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794d06-b81c-4ec8-900e-4f6d5efa1c59 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:00.653721 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794d06-b81c-4ec8-900e-4f6d5efa1c59 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:00.654002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794d06-b81c-4ec8-900e-4f6d5efa1c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:00.684946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f1794d06-b81c-4ec8-900e-4f6d5efa1c59 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:00.686464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f1794d06-b81c-4ec8-900e-4f6d5efa1c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:00.715945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3217608-04f3-42f4-85f9-9456c526ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:00.717140 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3217608-04f3-42f4-85f9-9456c526ab4c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:00.717636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3217608-04f3-42f4-85f9-9456c526ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:00.718095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3217608-04f3-42f4-85f9-9456c526ab4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:00.738170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3217608-04f3-42f4-85f9-9456c526ab4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:00.751454 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-c3217608-04f3-42f4-85f9-9456c526ab4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:06:00.759909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 183/384] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:00.768810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3217608-04f3-42f4-85f9-9456c526ab4c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:00.816060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 202/385] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:00.906463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3217608-04f3-42f4-85f9-9456c526ab4c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:00.940069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794d06-b81c-4ec8-900e-4f6d5efa1c59 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:00.975382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160eb6b-b29b-4b75-8165-23c208da3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:00.976429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160eb6b-b29b-4b75-8165-23c208da3b2f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:00.976903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160eb6b-b29b-4b75-8165-23c208da3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:00.977390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160eb6b-b29b-4b75-8165-23c208da3b2f None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:00.978648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160eb6b-b29b-4b75-8165-23c208da3b2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:00.979165 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160eb6b-b29b-4b75-8165-23c208da3b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:00.980726 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160eb6b-b29b-4b75-8165-23c208da3b2f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:01.001494 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 184/386] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:06:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:01.009404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160eb6b-b29b-4b75-8165-23c208da3b2f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:01.106225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794d06-b81c-4ec8-900e-4f6d5efa1c59 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:01.151271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcdce0-3a1e-4701-906b-6cb8bafc9804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:01.152433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcdce0-3a1e-4701-906b-6cb8bafc9804 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:01.152433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcdce0-3a1e-4701-906b-6cb8bafc9804 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:01.152683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcdce0-3a1e-4701-906b-6cb8bafc9804 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:01.180155 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcdce0-3a1e-4701-906b-6cb8bafc9804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:01.187718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-1afcdce0-3a1e-4701-906b-6cb8bafc9804 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:06:01.188955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 203/387] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:06:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:01.189764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160eb6b-b29b-4b75-8165-23c208da3b2f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:01.196336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcdce0-3a1e-4701-906b-6cb8bafc9804 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:01.234521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df90d8-5e95-4b55-935b-cb729396039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:01.235759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df90d8-5e95-4b55-935b-cb729396039a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:01.236242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df90d8-5e95-4b55-935b-cb729396039a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:01.236704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df90d8-5e95-4b55-935b-cb729396039a None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:01.239257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df90d8-5e95-4b55-935b-cb729396039a None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:01.240940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df90d8-5e95-4b55-935b-cb729396039a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:01.243101 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 185/388] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:06:01 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:01.248505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df90d8-5e95-4b55-935b-cb729396039a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:01.408837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcdce0-3a1e-4701-906b-6cb8bafc9804 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:01.433935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df90d8-5e95-4b55-935b-cb729396039a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:01.477003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0a7bd-ac4f-45a2-babb-856a1ca7a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:01.477680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a7bd-ac4f-45a2-babb-856a1ca7a436 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:01.477961 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a7bd-ac4f-45a2-babb-856a1ca7a436 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:01.478245 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a7bd-ac4f-45a2-babb-856a1ca7a436 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:01.478997 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0a7bd-ac4f-45a2-babb-856a1ca7a436 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:01.479307 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0a7bd-ac4f-45a2-babb-856a1ca7a436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:01.480678 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0a7bd-ac4f-45a2-babb-856a1ca7a436 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:01.498095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 204/389] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:01.499302 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a25524-af8d-49ff-8948-b4978d91c513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:01.500171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a25524-af8d-49ff-8948-b4978d91c513 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:01.500448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a25524-af8d-49ff-8948-b4978d91c513 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:01.500722 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a25524-af8d-49ff-8948-b4978d91c513 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:01.501965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a25524-af8d-49ff-8948-b4978d91c513 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:01.503422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a25524-af8d-49ff-8948-b4978d91c513 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:01.505639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0a7bd-ac4f-45a2-babb-856a1ca7a436 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:01.507545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 186/390] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:06:01 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:01.516032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a25524-af8d-49ff-8948-b4978d91c513 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:01.700265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a25524-af8d-49ff-8948-b4978d91c513 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:01.702561 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0a7bd-ac4f-45a2-babb-856a1ca7a436 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:01.739555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929dfd8-9210-46f3-9412-6a85d35b6916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:01.740546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929dfd8-9210-46f3-9412-6a85d35b6916 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:01.740838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929dfd8-9210-46f3-9412-6a85d35b6916 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:01.741193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929dfd8-9210-46f3-9412-6a85d35b6916 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144/groups/e51653a16b524006a76e2161c35edf49/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:01.742595 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930dfc-bbdd-4f7f-8dd9-7a1c6f99c72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:01.743446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929dfd8-9210-46f3-9412-6a85d35b6916 None admin] RBAC: Authorizing `identity:create_grant(project_id=658d1c3291ff49e386ba21e2afa82144, group_id=e51653a16b524006a76e2161c35edf49, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:01.743552 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930dfc-bbdd-4f7f-8dd9-7a1c6f99c72e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:01.743737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930dfc-bbdd-4f7f-8dd9-7a1c6f99c72e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:01.744019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930dfc-bbdd-4f7f-8dd9-7a1c6f99c72e None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:01.746980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929dfd8-9210-46f3-9412-6a85d35b6916 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:01.747221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28930dfc-bbdd-4f7f-8dd9-7a1c6f99c72e None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:01.748674 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28930dfc-bbdd-4f7f-8dd9-7a1c6f99c72e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:01.756201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 205/391] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:06:01 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:01.757316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930dfc-bbdd-4f7f-8dd9-7a1c6f99c72e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:01.862447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930dfc-bbdd-4f7f-8dd9-7a1c6f99c72e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:01.887874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 187/392] 10.222.0.61 () {58 vars in 1442 bytes} [Tue Apr 12 14:06:01 2022] PUT /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144/groups/e51653a16b524006a76e2161c35edf49/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:06:01.898071 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1690b-0173-495f-a55d-c076d2ba6d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:01.899314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1690b-0173-495f-a55d-c076d2ba6d96 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:01.899790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1690b-0173-495f-a55d-c076d2ba6d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:01.900256 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1690b-0173-495f-a55d-c076d2ba6d96 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:01.902000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1690b-0173-495f-a55d-c076d2ba6d96 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:01.903719 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1690b-0173-495f-a55d-c076d2ba6d96 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:01.905814 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 206/393] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:06:01 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:01.917007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929dfd8-9210-46f3-9412-6a85d35b6916 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:02.061368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929dfd8-9210-46f3-9412-6a85d35b6916 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:02.102095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ff304-99e5-4264-9244-560811815479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:02.103039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff304-99e5-4264-9244-560811815479 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:02.103323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff304-99e5-4264-9244-560811815479 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:02.103598 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff304-99e5-4264-9244-560811815479 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144/groups/e51653a16b524006a76e2161c35edf49/roles/b227940c19244df2b57662537283a467` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:02.105900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ff304-99e5-4264-9244-560811815479 None admin] RBAC: Authorizing `identity:create_grant(project_id=658d1c3291ff49e386ba21e2afa82144, group_id=e51653a16b524006a76e2161c35edf49, role_id=b227940c19244df2b57662537283a467)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:02.107338 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ff304-99e5-4264-9244-560811815479 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:02.187983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 188/394] 10.222.0.61 () {58 vars in 1442 bytes} [Tue Apr 12 14:06:01 2022] PUT /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144/groups/e51653a16b524006a76e2161c35edf49/roles/b227940c19244df2b57662537283a467 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:06:02.349061 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb8119-8013-4c1f-947b-3ba9bcf88607 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:02.350008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb8119-8013-4c1f-947b-3ba9bcf88607 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:02.350500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb8119-8013-4c1f-947b-3ba9bcf88607 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:02.352554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 207/395] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:02.358765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e8e-749d-48b1-803c-da178c488298 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:02.359058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e8e-749d-48b1-803c-da178c488298 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:02.359341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e8e-749d-48b1-803c-da178c488298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:02.377621 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fb1e3e8e-749d-48b1-803c-da178c488298 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:02.378827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fb1e3e8e-749d-48b1-803c-da178c488298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:02.465846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 189/396] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:02.497070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb8119-8013-4c1f-947b-3ba9bcf88607 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:02.614637 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb8119-8013-4c1f-947b-3ba9bcf88607 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:02.654316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9749e7-d65e-4cbd-95df-99419aec11f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:02.655123 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9749e7-d65e-4cbd-95df-99419aec11f7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:02.655414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9749e7-d65e-4cbd-95df-99419aec11f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:02.655690 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9749e7-d65e-4cbd-95df-99419aec11f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:02.669644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9749e7-d65e-4cbd-95df-99419aec11f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:02.677542 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-eb9749e7-d65e-4cbd-95df-99419aec11f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:06:02.679063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 208/397] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:02.684868 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3e8e-749d-48b1-803c-da178c488298 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:02.818083 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3e8e-749d-48b1-803c-da178c488298 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:02.859542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed67467-bc7c-4315-a5d7-703ad98a386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:02.860224 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67467-bc7c-4315-a5d7-703ad98a386c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:02.860513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67467-bc7c-4315-a5d7-703ad98a386c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:02.860795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67467-bc7c-4315-a5d7-703ad98a386c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:02.861571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed67467-bc7c-4315-a5d7-703ad98a386c None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:02.861882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed67467-bc7c-4315-a5d7-703ad98a386c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:02.863277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed67467-bc7c-4315-a5d7-703ad98a386c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:02.873655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 190/398] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:06:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:02.882156 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9749e7-d65e-4cbd-95df-99419aec11f7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:03.024504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9749e7-d65e-4cbd-95df-99419aec11f7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:03.074847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588a304-ab92-40e6-b99f-bb7863f9c938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:03.075718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588a304-ab92-40e6-b99f-bb7863f9c938 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:03.076001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588a304-ab92-40e6-b99f-bb7863f9c938 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:03.076277 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588a304-ab92-40e6-b99f-bb7863f9c938 None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:03.077480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588a304-ab92-40e6-b99f-bb7863f9c938 None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:03.078914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588a304-ab92-40e6-b99f-bb7863f9c938 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:03.080847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 209/399] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:06:02 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:03.087268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed67467-bc7c-4315-a5d7-703ad98a386c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:03.230540 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232c5b-98fb-4ee8-b693-d9ef48842542 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:03.231158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232c5b-98fb-4ee8-b693-d9ef48842542 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:03.231599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232c5b-98fb-4ee8-b693-d9ef48842542 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:03.234249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 210/400] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:03.238467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78928de3-8f78-42d5-8b53-6c3890e98727 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:03.238792 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78928de3-8f78-42d5-8b53-6c3890e98727 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:03.239093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78928de3-8f78-42d5-8b53-6c3890e98727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:03.247283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed67467-bc7c-4315-a5d7-703ad98a386c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:03.265022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-78928de3-8f78-42d5-8b53-6c3890e98727 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:03.267102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-78928de3-8f78-42d5-8b53-6c3890e98727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:03.309338 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f3332-ed18-47a8-bb1b-767f1b2e03e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:03.310629 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f3332-ed18-47a8-bb1b-767f1b2e03e9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:03.311137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f3332-ed18-47a8-bb1b-767f1b2e03e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:03.311610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f3332-ed18-47a8-bb1b-767f1b2e03e9 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:03.313905 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f3332-ed18-47a8-bb1b-767f1b2e03e9 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:03.315582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f3332-ed18-47a8-bb1b-767f1b2e03e9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:03.318471 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 191/401] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:06:03 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:03.324709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f3332-ed18-47a8-bb1b-767f1b2e03e9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:03.407550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 211/402] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:03.435237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0caaa-8a1e-49b3-a0b2-facf799f16be None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:03.435936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0caaa-8a1e-49b3-a0b2-facf799f16be None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:03.436988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0caaa-8a1e-49b3-a0b2-facf799f16be None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:03.443125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 212/403] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:06:03.443125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0caaa-8a1e-49b3-a0b2-facf799f16be None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:03.479490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f3332-ed18-47a8-bb1b-767f1b2e03e9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:03.524416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e57757-ea19-4487-93c8-9fff79f22db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:03.525453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e57757-ea19-4487-93c8-9fff79f22db6 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:03.526495 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e57757-ea19-4487-93c8-9fff79f22db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:03.527152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e57757-ea19-4487-93c8-9fff79f22db6 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0/groups/e51653a16b524006a76e2161c35edf49/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:03.533763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e57757-ea19-4487-93c8-9fff79f22db6 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f9fe5832664d93a19363ec71de67b0, group_id=e51653a16b524006a76e2161c35edf49, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:03.535557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e57757-ea19-4487-93c8-9fff79f22db6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:03.573267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0caaa-8a1e-49b3-a0b2-facf799f16be None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:03.609226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9376e-7186-42a8-b0ec-bc54cd6c5a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:03.610352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9376e-7186-42a8-b0ec-bc54cd6c5a12 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:03.610853 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9376e-7186-42a8-b0ec-bc54cd6c5a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:03.611341 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9376e-7186-42a8-b0ec-bc54cd6c5a12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:03.622122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 192/404] 10.222.0.61 () {58 vars in 1442 bytes} [Tue Apr 12 14:06:03 2022] PUT /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0/groups/e51653a16b524006a76e2161c35edf49/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:06:03.624045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69cc38-146e-48dd-914b-48c0cfbbe544 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:03.624560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69cc38-146e-48dd-914b-48c0cfbbe544 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:03.625243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69cc38-146e-48dd-914b-48c0cfbbe544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:03.632847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9376e-7186-42a8-b0ec-bc54cd6c5a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:03.639848 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-2bb9376e-7186-42a8-b0ec-bc54cd6c5a12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:06:03.643217 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 213/405] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:03.649293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9376e-7186-42a8-b0ec-bc54cd6c5a12 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:03.650674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ed69cc38-146e-48dd-914b-48c0cfbbe544 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:03.654701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ed69cc38-146e-48dd-914b-48c0cfbbe544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:03.809113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 193/406] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:03.849189 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9376e-7186-42a8-b0ec-bc54cd6c5a12 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:03.869778 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69cc38-146e-48dd-914b-48c0cfbbe544 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:03.888348 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e092f-43ea-4cd9-a6e6-ff9252738ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:03.889292 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e092f-43ea-4cd9-a6e6-ff9252738ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:03.889740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e092f-43ea-4cd9-a6e6-ff9252738ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:03.890174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e092f-43ea-4cd9-a6e6-ff9252738ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:03.891069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e092f-43ea-4cd9-a6e6-ff9252738ca1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:03.891525 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e092f-43ea-4cd9-a6e6-ff9252738ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:03.893059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e092f-43ea-4cd9-a6e6-ff9252738ca1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:03.902449 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 214/407] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:03.908851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e092f-43ea-4cd9-a6e6-ff9252738ca1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:03.979748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69cc38-146e-48dd-914b-48c0cfbbe544 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:04.014874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e092f-43ea-4cd9-a6e6-ff9252738ca1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:04.018709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d30aa-2917-49f5-b055-3204ace4f57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:04.019637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d30aa-2917-49f5-b055-3204ace4f57f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:04.020551 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d30aa-2917-49f5-b055-3204ace4f57f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:04.021078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d30aa-2917-49f5-b055-3204ace4f57f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:04.042214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d30aa-2917-49f5-b055-3204ace4f57f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:04.051112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-ab8d30aa-2917-49f5-b055-3204ace4f57f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:06:04.051477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 194/408] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:06:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:04.057111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d30aa-2917-49f5-b055-3204ace4f57f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:04.057959 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b9fa1-c4ff-4f20-ae7d-7ddef1be9615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:04.058998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9fa1-c4ff-4f20-ae7d-7ddef1be9615 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:04.059486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9fa1-c4ff-4f20-ae7d-7ddef1be9615 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:04.059932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9fa1-c4ff-4f20-ae7d-7ddef1be9615 None admin] PATH_INFO: `/v3/groups/eb039789f6c44a728355d1a911d1fda4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:04.062164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b9fa1-c4ff-4f20-ae7d-7ddef1be9615 None admin] RBAC: Authorizing `identity:get_group(group_id=eb039789f6c44a728355d1a911d1fda4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:04.063828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b9fa1-c4ff-4f20-ae7d-7ddef1be9615 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:04.066220 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 215/409] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:06:03 2022] GET /identity/v3/groups/eb039789f6c44a728355d1a911d1fda4 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:04.072527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b9fa1-c4ff-4f20-ae7d-7ddef1be9615 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:04.240280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b9fa1-c4ff-4f20-ae7d-7ddef1be9615 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:04.259816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d30aa-2917-49f5-b055-3204ace4f57f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:04.284854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75033-ef93-407e-bdff-9a820ba957a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:04.286620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75033-ef93-407e-bdff-9a820ba957a8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:04.287070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75033-ef93-407e-bdff-9a820ba957a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:04.287963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75033-ef93-407e-bdff-9a820ba957a8 None admin] PATH_INFO: `/v3/projects/1882ed88f2204017b2d59722788747c1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:04.291699 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab75033-ef93-407e-bdff-9a820ba957a8 None admin] RBAC: Authorizing `identity:get_project(project_id=1882ed88f2204017b2d59722788747c1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:04.293384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab75033-ef93-407e-bdff-9a820ba957a8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:04.299045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 216/410] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:06:04 2022] GET /identity/v3/projects/1882ed88f2204017b2d59722788747c1 => generated 344 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:04.305511 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75033-ef93-407e-bdff-9a820ba957a8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:04.322233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdd4a9-5db2-492b-a77b-3c804258adaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:04.322837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdd4a9-5db2-492b-a77b-3c804258adaa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:04.323120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdd4a9-5db2-492b-a77b-3c804258adaa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:04.323392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdd4a9-5db2-492b-a77b-3c804258adaa None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:04.324228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdd4a9-5db2-492b-a77b-3c804258adaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:04.324441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdd4a9-5db2-492b-a77b-3c804258adaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:04.325843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdd4a9-5db2-492b-a77b-3c804258adaa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:04.340716 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 195/411] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:04.349007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdd4a9-5db2-492b-a77b-3c804258adaa None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:04.421382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75033-ef93-407e-bdff-9a820ba957a8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:04.466609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c20d6-9719-4802-92d5-69cd33f9d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:04.467876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c20d6-9719-4802-92d5-69cd33f9d9be None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:04.468362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c20d6-9719-4802-92d5-69cd33f9d9be None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:04.468816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c20d6-9719-4802-92d5-69cd33f9d9be None admin] PATH_INFO: `/v3/projects/1882ed88f2204017b2d59722788747c1/groups/eb039789f6c44a728355d1a911d1fda4/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:04.474316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c20d6-9719-4802-92d5-69cd33f9d9be None admin] RBAC: Authorizing `identity:create_grant(project_id=1882ed88f2204017b2d59722788747c1, group_id=eb039789f6c44a728355d1a911d1fda4, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:04.475972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c20d6-9719-4802-92d5-69cd33f9d9be None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:04.478927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdd4a9-5db2-492b-a77b-3c804258adaa None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:04.513118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ea87b-3080-42c3-86c3-b9ea256562c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:04.513980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ea87b-3080-42c3-86c3-b9ea256562c2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:04.514261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ea87b-3080-42c3-86c3-b9ea256562c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:04.514538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ea87b-3080-42c3-86c3-b9ea256562c2 None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:04.515798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ea87b-3080-42c3-86c3-b9ea256562c2 None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:04.517273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ea87b-3080-42c3-86c3-b9ea256562c2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:04.519213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 196/412] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:06:04 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:04.525279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ea87b-3080-42c3-86c3-b9ea256562c2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:04.570121 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 217/413] 10.222.0.61 () {58 vars in 1442 bytes} [Tue Apr 12 14:06:04 2022] PUT /identity/v3/projects/1882ed88f2204017b2d59722788747c1/groups/eb039789f6c44a728355d1a911d1fda4/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:06:04.649044 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ea87b-3080-42c3-86c3-b9ea256562c2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:04.698288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e09c5-c08b-42c8-ace3-247d6eeb337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:04.699236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e09c5-c08b-42c8-ace3-247d6eeb337e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:04.699525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e09c5-c08b-42c8-ace3-247d6eeb337e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:04.699802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e09c5-c08b-42c8-ace3-247d6eeb337e None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:04.701073 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e09c5-c08b-42c8-ace3-247d6eeb337e None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:04.702550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e09c5-c08b-42c8-ace3-247d6eeb337e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:04.709441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 197/414] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:06:04 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:04.711201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c20d6-9719-4802-92d5-69cd33f9d9be None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:04.869787 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c20d6-9719-4802-92d5-69cd33f9d9be None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:04.906962 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408278d4-8816-4db6-be67-2b0ad80db93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:04.908237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408278d4-8816-4db6-be67-2b0ad80db93d None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:04.908744 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408278d4-8816-4db6-be67-2b0ad80db93d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:04.908855 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bc7da-5b5b-4551-b979-47167dc541f6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:04.909131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bc7da-5b5b-4551-b979-47167dc541f6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:04.909416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bc7da-5b5b-4551-b979-47167dc541f6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:04.909752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408278d4-8816-4db6-be67-2b0ad80db93d None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0/groups/e51653a16b524006a76e2161c35edf49/roles/b227940c19244df2b57662537283a467` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:04.911262 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 198/415] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:04.916439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408278d4-8816-4db6-be67-2b0ad80db93d None admin] RBAC: Authorizing `identity:create_grant(project_id=67f9fe5832664d93a19363ec71de67b0, group_id=e51653a16b524006a76e2161c35edf49, role_id=b227940c19244df2b57662537283a467)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:04.916567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab1010-58b3-453b-8bd9-58276c874e06 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:04.916820 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab1010-58b3-453b-8bd9-58276c874e06 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:04.917148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab1010-58b3-453b-8bd9-58276c874e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:04.918864 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408278d4-8816-4db6-be67-2b0ad80db93d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:04.936164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3bab1010-58b3-453b-8bd9-58276c874e06 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:04.937517 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3bab1010-58b3-453b-8bd9-58276c874e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:04.993744 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 218/416] 10.222.0.61 () {58 vars in 1442 bytes} [Tue Apr 12 14:06:04 2022] PUT /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0/groups/e51653a16b524006a76e2161c35edf49/roles/b227940c19244df2b57662537283a467 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:06:05.029057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 199/417] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:05.074815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408278d4-8816-4db6-be67-2b0ad80db93d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:05.207324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408278d4-8816-4db6-be67-2b0ad80db93d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:05.251174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8c309-bf97-4c4f-a82d-71b670dfa839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:05.251979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8c309-bf97-4c4f-a82d-71b670dfa839 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:05.252263 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8c309-bf97-4c4f-a82d-71b670dfa839 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:05.252543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8c309-bf97-4c4f-a82d-71b670dfa839 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:05.267695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8c309-bf97-4c4f-a82d-71b670dfa839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:05.275524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-ebd8c309-bf97-4c4f-a82d-71b670dfa839 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:06:05.277009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 219/418] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:05.283089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab1010-58b3-453b-8bd9-58276c874e06 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:05.329468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c6b5-9687-4299-a3c5-98d1b53e4f37 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:05.329787 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c6b5-9687-4299-a3c5-98d1b53e4f37 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:05.330023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c6b5-9687-4299-a3c5-98d1b53e4f37 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:05.331653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 220/419] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:05.337206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4b7f9-dc97-49e3-a7a6-528e42a8eb32 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:05.337495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4b7f9-dc97-49e3-a7a6-528e42a8eb32 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:05.337779 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4b7f9-dc97-49e3-a7a6-528e42a8eb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:05.355715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3ef4b7f9-dc97-49e3-a7a6-528e42a8eb32 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:05.356897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ef4b7f9-dc97-49e3-a7a6-528e42a8eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:05.402983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab1010-58b3-453b-8bd9-58276c874e06 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:05.449233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 221/420] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:06:05.458926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10fc33-35a9-4262-8978-7ad985dcb6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:05.459900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10fc33-35a9-4262-8978-7ad985dcb6fd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:05.460388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10fc33-35a9-4262-8978-7ad985dcb6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:05.460862 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10fc33-35a9-4262-8978-7ad985dcb6fd None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:05.461850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10fc33-35a9-4262-8978-7ad985dcb6fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:05.462361 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10fc33-35a9-4262-8978-7ad985dcb6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:05.463933 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10fc33-35a9-4262-8978-7ad985dcb6fd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:05.477021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 200/421] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:06:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:05.478761 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4b7f9-dc97-49e3-a7a6-528e42a8eb32 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:05.491430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10fc33-35a9-4262-8978-7ad985dcb6fd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:05.612428 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10fc33-35a9-4262-8978-7ad985dcb6fd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:05.650809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781f108-36c7-4aba-8332-8637cbde1198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:05.651970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f108-36c7-4aba-8332-8637cbde1198 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:05.652474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f108-36c7-4aba-8332-8637cbde1198 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:05.652984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f108-36c7-4aba-8332-8637cbde1198 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:05.666644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781f108-36c7-4aba-8332-8637cbde1198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:05.675194 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-5781f108-36c7-4aba-8332-8637cbde1198 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:06:05.677850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 201/422] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:06:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:05.684560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781f108-36c7-4aba-8332-8637cbde1198 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:05.705338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4b7f9-dc97-49e3-a7a6-528e42a8eb32 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:05.760124 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9944b88-5e78-4fa1-b833-d508ca5692ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:05.761033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944b88-5e78-4fa1-b833-d508ca5692ab None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:05.761463 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944b88-5e78-4fa1-b833-d508ca5692ab None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:05.761904 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944b88-5e78-4fa1-b833-d508ca5692ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:05.839801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9944b88-5e78-4fa1-b833-d508ca5692ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:05.841709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9944b88-5e78-4fa1-b833-d508ca5692ab None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:05.880660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781f108-36c7-4aba-8332-8637cbde1198 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:05.915360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e532-430b-442e-9e5d-a2e0942536b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:05.916030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e532-430b-442e-9e5d-a2e0942536b1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:05.916362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e532-430b-442e-9e5d-a2e0942536b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:05.916646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e532-430b-442e-9e5d-a2e0942536b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:05.917441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561e532-430b-442e-9e5d-a2e0942536b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:05.917753 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561e532-430b-442e-9e5d-a2e0942536b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:05.919150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561e532-430b-442e-9e5d-a2e0942536b1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:05.927894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 202/423] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:05.933907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e532-430b-442e-9e5d-a2e0942536b1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:05.951365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 222/424] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:05.966249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9944b88-5e78-4fa1-b833-d508ca5692ab None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:06.049062 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e532-430b-442e-9e5d-a2e0942536b1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:06.083981 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c788c-cd51-4e0e-acf8-fd7dfe2cf760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:06.084634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c788c-cd51-4e0e-acf8-fd7dfe2cf760 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:06.085185 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c788c-cd51-4e0e-acf8-fd7dfe2cf760 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:06.085664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c788c-cd51-4e0e-acf8-fd7dfe2cf760 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:06.151126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9944b88-5e78-4fa1-b833-d508ca5692ab None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:06.158618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c788c-cd51-4e0e-acf8-fd7dfe2cf760 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:06.160209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c788c-cd51-4e0e-acf8-fd7dfe2cf760 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:06.194680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31103bec-be2e-4b87-a139-8b129af49a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:06.195936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31103bec-be2e-4b87-a139-8b129af49a39 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:06.196425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31103bec-be2e-4b87-a139-8b129af49a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:06.197151 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31103bec-be2e-4b87-a139-8b129af49a39 None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:06.201739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31103bec-be2e-4b87-a139-8b129af49a39 None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:06.203396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31103bec-be2e-4b87-a139-8b129af49a39 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:06.209058 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 223/425] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:06:05 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:06.214108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31103bec-be2e-4b87-a139-8b129af49a39 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:06.271216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 203/426] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:06.278199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c788c-cd51-4e0e-acf8-fd7dfe2cf760 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:06.333997 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31103bec-be2e-4b87-a139-8b129af49a39 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:06.368383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c836d-270f-4d6a-b085-8aba938763a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:06.369630 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c836d-270f-4d6a-b085-8aba938763a9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:06.370127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c836d-270f-4d6a-b085-8aba938763a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:06.370600 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c836d-270f-4d6a-b085-8aba938763a9 None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:06.372007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c836d-270f-4d6a-b085-8aba938763a9 None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:06.373745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c836d-270f-4d6a-b085-8aba938763a9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:06.375949 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 224/427] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:06:06 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:06.377416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10935-aaea-481f-99d0-f41c4712ff8d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:06.377906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10935-aaea-481f-99d0-f41c4712ff8d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:06.378379 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10935-aaea-481f-99d0-f41c4712ff8d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:06.380186 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 225/428] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:06.381424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c10935-aaea-481f-99d0-f41c4712ff8d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:06.405467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c788c-cd51-4e0e-acf8-fd7dfe2cf760 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:06.440796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbe042-2bfa-4793-b3d4-3575f8646dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:06.441787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe042-2bfa-4793-b3d4-3575f8646dfa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:06.442126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe042-2bfa-4793-b3d4-3575f8646dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:06.442408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe042-2bfa-4793-b3d4-3575f8646dfa None admin] PATH_INFO: `/v3/projects/658d1c3291ff49e386ba21e2afa82144` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:06.443658 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbe042-2bfa-4793-b3d4-3575f8646dfa None admin] RBAC: Authorizing `identity:get_project(project_id=658d1c3291ff49e386ba21e2afa82144)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:06.445336 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbe042-2bfa-4793-b3d4-3575f8646dfa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:06.447849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 204/429] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:06:06 2022] GET /identity/v3/projects/658d1c3291ff49e386ba21e2afa82144 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:06.453301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00bdc4-103f-4b54-bbfc-17d8e58f1f86 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:06.453773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00bdc4-103f-4b54-bbfc-17d8e58f1f86 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:06.454199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00bdc4-103f-4b54-bbfc-17d8e58f1f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:06.472871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0d00bdc4-103f-4b54-bbfc-17d8e58f1f86 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:06.475145 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0d00bdc4-103f-4b54-bbfc-17d8e58f1f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:06.490546 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c10935-aaea-481f-99d0-f41c4712ff8d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:06.525670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb20b-548b-4ce9-8f99-457c40532e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:06.526517 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb20b-548b-4ce9-8f99-457c40532e31 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:06.526919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb20b-548b-4ce9-8f99-457c40532e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:06.527264 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb20b-548b-4ce9-8f99-457c40532e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:06.528189 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fb20b-548b-4ce9-8f99-457c40532e31 None admin] RBAC: Adding query filter params (group.id=e51653a16b524006a76e2161c35edf49, role.id=a0c62419d02f426ea41c7faf22b2bf8a, scope.project.id=658d1c3291ff49e386ba21e2afa82144) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:06.528624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fb20b-548b-4ce9-8f99-457c40532e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:06.530169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fb20b-548b-4ce9-8f99-457c40532e31 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:06.537116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 226/430] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Apr 12 14:06:06 2022] GET /identity/v3/role_assignments?group.id=e51653a16b524006a76e2161c35edf49&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:06.538008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb20b-548b-4ce9-8f99-457c40532e31 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:06.544781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 205/431] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:06.584189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00bdc4-103f-4b54-bbfc-17d8e58f1f86 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:06.650011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb20b-548b-4ce9-8f99-457c40532e31 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:06.706743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50d36-b2ba-4e20-a81c-f9cd778ee6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:06.707929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50d36-b2ba-4e20-a81c-f9cd778ee6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:06.708222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50d36-b2ba-4e20-a81c-f9cd778ee6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:06.708499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50d36-b2ba-4e20-a81c-f9cd778ee6e4 None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:06.712837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50d36-b2ba-4e20-a81c-f9cd778ee6e4 None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:06.714358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50d36-b2ba-4e20-a81c-f9cd778ee6e4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:06.716366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 227/432] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:06:06 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:06.725789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50d36-b2ba-4e20-a81c-f9cd778ee6e4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:06.806035 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00bdc4-103f-4b54-bbfc-17d8e58f1f86 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:06.853202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2357506-85e0-4264-82fa-103ef040837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:06.853936 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2357506-85e0-4264-82fa-103ef040837e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:06.854219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2357506-85e0-4264-82fa-103ef040837e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:06.854495 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2357506-85e0-4264-82fa-103ef040837e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:06.864404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50d36-b2ba-4e20-a81c-f9cd778ee6e4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:06.868584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2357506-85e0-4264-82fa-103ef040837e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:06.877786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-e2357506-85e0-4264-82fa-103ef040837e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 14:06:06.884512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 206/433] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:06.885406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2357506-85e0-4264-82fa-103ef040837e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:06.904592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f21af7-01b5-4f9a-af70-6bc93289de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:06.905544 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f21af7-01b5-4f9a-af70-6bc93289de6b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:06.905832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f21af7-01b5-4f9a-af70-6bc93289de6b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:06.906109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f21af7-01b5-4f9a-af70-6bc93289de6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:06.908179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f21af7-01b5-4f9a-af70-6bc93289de6b None admin] RBAC: Adding query filter params (group.id=e51653a16b524006a76e2161c35edf49, role.id=b227940c19244df2b57662537283a467, scope.project.id=658d1c3291ff49e386ba21e2afa82144) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:06.908730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f21af7-01b5-4f9a-af70-6bc93289de6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:06.910202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f21af7-01b5-4f9a-af70-6bc93289de6b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:06.918625 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 228/434] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Apr 12 14:06:06 2022] GET /identity/v3/role_assignments?group.id=e51653a16b524006a76e2161c35edf49&scope.project.id=658d1c3291ff49e386ba21e2afa82144&role.id=b227940c19244df2b57662537283a467 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:07.019583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2357506-85e0-4264-82fa-103ef040837e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:07.057722 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48407adf-a98d-41ce-bd2a-989a7568a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:07.058409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407adf-a98d-41ce-bd2a-989a7568a796 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:07.058696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407adf-a98d-41ce-bd2a-989a7568a796 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:07.058975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407adf-a98d-41ce-bd2a-989a7568a796 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:07.059749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48407adf-a98d-41ce-bd2a-989a7568a796 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:07.060059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48407adf-a98d-41ce-bd2a-989a7568a796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:07.061513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48407adf-a98d-41ce-bd2a-989a7568a796 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:07.071766 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 207/435] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:06:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:07.079104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f21af7-01b5-4f9a-af70-6bc93289de6b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:07.199566 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f21af7-01b5-4f9a-af70-6bc93289de6b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:07.234132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1f7cc-0944-4293-a52a-efd2b0d520cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:07.234793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1f7cc-0944-4293-a52a-efd2b0d520cd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:07.235081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1f7cc-0944-4293-a52a-efd2b0d520cd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:07.235360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1f7cc-0944-4293-a52a-efd2b0d520cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:07.305718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1f7cc-0944-4293-a52a-efd2b0d520cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:07.307166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1f7cc-0944-4293-a52a-efd2b0d520cd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:07.411383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 229/436] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:07.417202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48407adf-a98d-41ce-bd2a-989a7568a796 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:07.528682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48407adf-a98d-41ce-bd2a-989a7568a796 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:07.544398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef14d-4e3e-48ef-aa38-e91a58a19055 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:07.544886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef14d-4e3e-48ef-aa38-e91a58a19055 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:07.544980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef14d-4e3e-48ef-aa38-e91a58a19055 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:07.546578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 230/437] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:07.552662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e6354-697c-4872-b1b5-1f9a7efb0c43 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:07.553065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e6354-697c-4872-b1b5-1f9a7efb0c43 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:07.553349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e6354-697c-4872-b1b5-1f9a7efb0c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:07.563515 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a9ca2-2115-4a3c-b34d-6b9105430f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:07.564561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a9ca2-2115-4a3c-b34d-6b9105430f21 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:07.565006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a9ca2-2115-4a3c-b34d-6b9105430f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:07.565439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a9ca2-2115-4a3c-b34d-6b9105430f21 None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:07.567296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a9ca2-2115-4a3c-b34d-6b9105430f21 None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:07.568870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a9ca2-2115-4a3c-b34d-6b9105430f21 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:07.570037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5a2e6354-697c-4872-b1b5-1f9a7efb0c43 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:07.570908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 208/438] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:06:07 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:07.571216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5a2e6354-697c-4872-b1b5-1f9a7efb0c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:07.576827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a9ca2-2115-4a3c-b34d-6b9105430f21 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:07.637772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 231/439] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:07.663568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e6354-697c-4872-b1b5-1f9a7efb0c43 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:07.688316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a9ca2-2115-4a3c-b34d-6b9105430f21 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:07.721996 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae2006-facc-4cae-b65e-61e0617d7dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:07.723496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae2006-facc-4cae-b65e-61e0617d7dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:07.723784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae2006-facc-4cae-b65e-61e0617d7dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:07.724064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae2006-facc-4cae-b65e-61e0617d7dc9 None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:07.725294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae2006-facc-4cae-b65e-61e0617d7dc9 None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:07.726742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae2006-facc-4cae-b65e-61e0617d7dc9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:07.728365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 209/440] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:06:07 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:07.733894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae2006-facc-4cae-b65e-61e0617d7dc9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:07.779103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e6354-697c-4872-b1b5-1f9a7efb0c43 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:07.812386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a7cd7-707b-4fa6-8166-b166b0b4a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:07.813224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7cd7-707b-4fa6-8166-b166b0b4a259 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:07.813510 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7cd7-707b-4fa6-8166-b166b0b4a259 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:07.813788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7cd7-707b-4fa6-8166-b166b0b4a259 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:07.824630 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a7cd7-707b-4fa6-8166-b166b0b4a259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:07.831564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-632a7cd7-707b-4fa6-8166-b166b0b4a259 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:06:07.833348 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 232/441] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:07.835900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae2006-facc-4cae-b65e-61e0617d7dc9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:07.839023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a7cd7-707b-4fa6-8166-b166b0b4a259 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:07.869575 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f7a8e-e211-4a91-b8d6-d6b1efe525ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:07.870234 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f7a8e-e211-4a91-b8d6-d6b1efe525ad None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:07.870519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f7a8e-e211-4a91-b8d6-d6b1efe525ad None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:07.870796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f7a8e-e211-4a91-b8d6-d6b1efe525ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:07.871623 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f7a8e-e211-4a91-b8d6-d6b1efe525ad None admin] RBAC: Adding query filter params (group.id=e51653a16b524006a76e2161c35edf49, role.id=a0c62419d02f426ea41c7faf22b2bf8a, scope.project.id=67f9fe5832664d93a19363ec71de67b0) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:07.871934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f7a8e-e211-4a91-b8d6-d6b1efe525ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:07.873667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f7a8e-e211-4a91-b8d6-d6b1efe525ad None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:07.879906 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 210/442] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Apr 12 14:06:07 2022] GET /identity/v3/role_assignments?group.id=e51653a16b524006a76e2161c35edf49&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=a0c62419d02f426ea41c7faf22b2bf8a => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:07.881153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a6117-ed1b-4a2e-856b-9a3e0df22619 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:07.881437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a6117-ed1b-4a2e-856b-9a3e0df22619 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:07.881712 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a6117-ed1b-4a2e-856b-9a3e0df22619 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:07.885123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 211/443] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:07.888536 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772b1e5-e304-42d9-87c3-f787293e8016 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:07.888813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772b1e5-e304-42d9-87c3-f787293e8016 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:07.889126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772b1e5-e304-42d9-87c3-f787293e8016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:07.906591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e772b1e5-e304-42d9-87c3-f787293e8016 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:07.907814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e772b1e5-e304-42d9-87c3-f787293e8016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:07.953455 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a7cd7-707b-4fa6-8166-b166b0b4a259 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:07.977764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 212/444] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:06:07.990228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af827d-b2ad-464d-81f6-df8b10b7591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:07.990905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af827d-b2ad-464d-81f6-df8b10b7591e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:07.991188 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af827d-b2ad-464d-81f6-df8b10b7591e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:07.991463 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af827d-b2ad-464d-81f6-df8b10b7591e None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:07.992210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af827d-b2ad-464d-81f6-df8b10b7591e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:07.992524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af827d-b2ad-464d-81f6-df8b10b7591e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:07.993932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af827d-b2ad-464d-81f6-df8b10b7591e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:08.002584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772b1e5-e304-42d9-87c3-f787293e8016 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:08.003144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 233/445] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:08.009267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af827d-b2ad-464d-81f6-df8b10b7591e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:08.108008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772b1e5-e304-42d9-87c3-f787293e8016 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:08.120916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af827d-b2ad-464d-81f6-df8b10b7591e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:08.143804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ace77-6935-4b7f-8cd0-b1662e4c6803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:08.144724 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ace77-6935-4b7f-8cd0-b1662e4c6803 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:08.145162 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ace77-6935-4b7f-8cd0-b1662e4c6803 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:08.145448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ace77-6935-4b7f-8cd0-b1662e4c6803 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:08.155630 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ace77-6935-4b7f-8cd0-b1662e4c6803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:08.157766 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc03e62-1f9e-4281-ac38-b5c21b0d5399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:08.158412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03e62-1f9e-4281-ac38-b5c21b0d5399 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:08.158696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03e62-1f9e-4281-ac38-b5c21b0d5399 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:08.158972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03e62-1f9e-4281-ac38-b5c21b0d5399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:08.163542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-298ace77-6935-4b7f-8cd0-b1662e4c6803 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:06:08.164994 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 213/446] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:06:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:08.170413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ace77-6935-4b7f-8cd0-b1662e4c6803 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:08.245680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc03e62-1f9e-4281-ac38-b5c21b0d5399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:08.247127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc03e62-1f9e-4281-ac38-b5c21b0d5399 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:08.284423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ace77-6935-4b7f-8cd0-b1662e4c6803 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:08.317415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f712f-d2c5-4448-95f7-4714696e90ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:08.318072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f712f-d2c5-4448-95f7-4714696e90ab None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:08.318357 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f712f-d2c5-4448-95f7-4714696e90ab None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:08.318634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f712f-d2c5-4448-95f7-4714696e90ab None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:08.319366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f712f-d2c5-4448-95f7-4714696e90ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:08.319677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f712f-d2c5-4448-95f7-4714696e90ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:08.321072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f712f-d2c5-4448-95f7-4714696e90ab None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:08.328856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 214/447] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:08.334873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f712f-d2c5-4448-95f7-4714696e90ab None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:08.347484 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 234/448] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 14:06:08.353444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc03e62-1f9e-4281-ac38-b5c21b0d5399 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:08.428138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f712f-d2c5-4448-95f7-4714696e90ab None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:08.443356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc03e62-1f9e-4281-ac38-b5c21b0d5399 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:08.459890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba7e26-383f-4183-8ce0-37c2457bee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:08.460532 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba7e26-383f-4183-8ce0-37c2457bee1f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:08.460811 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba7e26-383f-4183-8ce0-37c2457bee1f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:08.461120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba7e26-383f-4183-8ce0-37c2457bee1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:08.476159 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d5d7a-1203-4937-a275-f29a0aa369cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:08.477037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d5d7a-1203-4937-a275-f29a0aa369cb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:08.477320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d5d7a-1203-4937-a275-f29a0aa369cb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:08.477597 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d5d7a-1203-4937-a275-f29a0aa369cb None admin] PATH_INFO: `/v3/projects/1882ed88f2204017b2d59722788747c1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:08.478778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d5d7a-1203-4937-a275-f29a0aa369cb None admin] RBAC: Authorizing `identity:get_project(project_id=1882ed88f2204017b2d59722788747c1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:08.480494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d5d7a-1203-4937-a275-f29a0aa369cb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:08.482505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 235/449] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:06:08 2022] GET /identity/v3/projects/1882ed88f2204017b2d59722788747c1 => generated 344 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:08.487696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d5d7a-1203-4937-a275-f29a0aa369cb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:08.525091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba7e26-383f-4183-8ce0-37c2457bee1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:08.526528 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba7e26-383f-4183-8ce0-37c2457bee1f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:08.580323 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d5d7a-1203-4937-a275-f29a0aa369cb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:08.612660 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b63bd8-6d0b-4e73-af8e-d4d1a00e3000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:08.613616 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b63bd8-6d0b-4e73-af8e-d4d1a00e3000 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:08.614121 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b63bd8-6d0b-4e73-af8e-d4d1a00e3000 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:08.614406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b63bd8-6d0b-4e73-af8e-d4d1a00e3000 None admin] PATH_INFO: `/v3/groups/eb039789f6c44a728355d1a911d1fda4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:08.615578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b63bd8-6d0b-4e73-af8e-d4d1a00e3000 None admin] RBAC: Authorizing `identity:get_group(group_id=eb039789f6c44a728355d1a911d1fda4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:08.617022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b63bd8-6d0b-4e73-af8e-d4d1a00e3000 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:08.617239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 215/450] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 14:06:08.621015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 236/451] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:06:08 2022] GET /identity/v3/groups/eb039789f6c44a728355d1a911d1fda4 => generated 229 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:08.623000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba7e26-383f-4183-8ce0-37c2457bee1f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:08.623893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b63bd8-6d0b-4e73-af8e-d4d1a00e3000 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:08.716832 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba7e26-383f-4183-8ce0-37c2457bee1f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:08.717068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b63bd8-6d0b-4e73-af8e-d4d1a00e3000 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:08.748535 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e0330-73be-4337-9a4f-4c60308db64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:08.748703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17288f6-f608-40a1-b544-cd0c39afeb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:08.749256 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17288f6-f608-40a1-b544-cd0c39afeb21 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:08.749409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e0330-73be-4337-9a4f-4c60308db64f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:08.749543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17288f6-f608-40a1-b544-cd0c39afeb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:08.749681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e0330-73be-4337-9a4f-4c60308db64f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:08.749819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17288f6-f608-40a1-b544-cd0c39afeb21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:08.749946 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e0330-73be-4337-9a4f-4c60308db64f None admin] PATH_INFO: `/v3/projects/67f9fe5832664d93a19363ec71de67b0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:08.750642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17288f6-f608-40a1-b544-cd0c39afeb21 None admin] RBAC: Adding query filter params (group.id=eb039789f6c44a728355d1a911d1fda4, role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=1882ed88f2204017b2d59722788747c1) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:08.750956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17288f6-f608-40a1-b544-cd0c39afeb21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:08.751161 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e0330-73be-4337-9a4f-4c60308db64f None admin] RBAC: Authorizing `identity:get_project(project_id=67f9fe5832664d93a19363ec71de67b0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:08.752366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17288f6-f608-40a1-b544-cd0c39afeb21 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:08.752511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e0330-73be-4337-9a4f-4c60308db64f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:08.754970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 216/452] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:06:08 2022] GET /identity/v3/projects/67f9fe5832664d93a19363ec71de67b0 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:08.769011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 237/453] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Apr 12 14:06:08 2022] GET /identity/v3/role_assignments?group.id=eb039789f6c44a728355d1a911d1fda4&scope.project.id=1882ed88f2204017b2d59722788747c1&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:08.769234 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e0330-73be-4337-9a4f-4c60308db64f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:08.862158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e0330-73be-4337-9a4f-4c60308db64f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:08.897616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749926cb-9bb0-4151-868d-365ad799c905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:08.898477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749926cb-9bb0-4151-868d-365ad799c905 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:08.898757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749926cb-9bb0-4151-868d-365ad799c905 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:08.899029 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749926cb-9bb0-4151-868d-365ad799c905 None admin] PATH_INFO: `/v3/groups/e51653a16b524006a76e2161c35edf49` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:08.900233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749926cb-9bb0-4151-868d-365ad799c905 None admin] RBAC: Authorizing `identity:get_group(group_id=e51653a16b524006a76e2161c35edf49)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:08.901714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749926cb-9bb0-4151-868d-365ad799c905 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:08.903364 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 217/454] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Apr 12 14:06:08 2022] GET /identity/v3/groups/e51653a16b524006a76e2161c35edf49 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:08.909372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17288f6-f608-40a1-b544-cd0c39afeb21 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:09.008134 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17288f6-f608-40a1-b544-cd0c39afeb21 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:09.040035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449736a0-c581-4d77-bc5e-465b3c204d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:09.040680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449736a0-c581-4d77-bc5e-465b3c204d47 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:09.040991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449736a0-c581-4d77-bc5e-465b3c204d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:09.041267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449736a0-c581-4d77-bc5e-465b3c204d47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:09.042081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449736a0-c581-4d77-bc5e-465b3c204d47 None admin] RBAC: Adding query filter params (group.id=e51653a16b524006a76e2161c35edf49, role.id=b227940c19244df2b57662537283a467, scope.project.id=67f9fe5832664d93a19363ec71de67b0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:09.042393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449736a0-c581-4d77-bc5e-465b3c204d47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:09.043806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449736a0-c581-4d77-bc5e-465b3c204d47 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:09.049324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 238/455] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Apr 12 14:06:08 2022] GET /identity/v3/role_assignments?group.id=e51653a16b524006a76e2161c35edf49&scope.project.id=67f9fe5832664d93a19363ec71de67b0&role.id=b227940c19244df2b57662537283a467 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:12.069209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30335-855e-45d1-b2ec-2db92f6ce524 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.070133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30335-855e-45d1-b2ec-2db92f6ce524 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.070592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30335-855e-45d1-b2ec-2db92f6ce524 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.072859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 218/456] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:12.078342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0f02-5104-487a-ad32-ac544fe5a463 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.078978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0f02-5104-487a-ad32-ac544fe5a463 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.079483 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0f02-5104-487a-ad32-ac544fe5a463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.083201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489400-6d11-4df1-8755-f5f4ac625faf None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.084537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489400-6d11-4df1-8755-f5f4ac625faf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.085615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489400-6d11-4df1-8755-f5f4ac625faf None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.091030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 239/457] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:12.107206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e5dbe-5a51-4452-80fc-762019b80e2f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.107822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e5dbe-5a51-4452-80fc-762019b80e2f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.108298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e5dbe-5a51-4452-80fc-762019b80e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.109592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-597c0f02-5104-487a-ad32-ac544fe5a463 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:12.111012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-597c0f02-5104-487a-ad32-ac544fe5a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:12.138822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c12e5dbe-5a51-4452-80fc-762019b80e2f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:12.140615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c12e5dbe-5a51-4452-80fc-762019b80e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:12.229071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 219/458] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:12.251077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c0f02-5104-487a-ad32-ac544fe5a463 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:12.271963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 240/459] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:06:12.335348 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e5dbe-5a51-4452-80fc-762019b80e2f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:12.362303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c0f02-5104-487a-ad32-ac544fe5a463 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:12.397965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc757b-6a9c-41f6-9b0f-c8cf8a8e7259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:12.399026 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc757b-6a9c-41f6-9b0f-c8cf8a8e7259 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.399448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc757b-6a9c-41f6-9b0f-c8cf8a8e7259 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.399962 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc757b-6a9c-41f6-9b0f-c8cf8a8e7259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.411104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc757b-6a9c-41f6-9b0f-c8cf8a8e7259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:12.412756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc757b-6a9c-41f6-9b0f-c8cf8a8e7259 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:12.431197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-bfcc757b-6a9c-41f6-9b0f-c8cf8a8e7259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:12.437063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 220/460] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:12.438700 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc757b-6a9c-41f6-9b0f-c8cf8a8e7259 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:12.540213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc757b-6a9c-41f6-9b0f-c8cf8a8e7259 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:12.558862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e5dbe-5a51-4452-80fc-762019b80e2f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:12.574833 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8aa2-c053-4715-836c-91027e401059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:12.575731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8aa2-c053-4715-836c-91027e401059 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.576182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8aa2-c053-4715-836c-91027e401059 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.576600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8aa2-c053-4715-836c-91027e401059 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.577487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8aa2-c053-4715-836c-91027e401059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:12.577935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8aa2-c053-4715-836c-91027e401059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:12.579455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8aa2-c053-4715-836c-91027e401059 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:12.603146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 221/461] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:12.603146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95612e2-f186-466b-80bd-dfa559968ea8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.603146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95612e2-f186-466b-80bd-dfa559968ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.603146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95612e2-f186-466b-80bd-dfa559968ea8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.605519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 222/462] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:12.606039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95612e2-f186-466b-80bd-dfa559968ea8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:12.622635 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bea5b3-50b9-4610-8e6c-8786f93c191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:12.623757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea5b3-50b9-4610-8e6c-8786f93c191a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.624237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea5b3-50b9-4610-8e6c-8786f93c191a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.624723 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea5b3-50b9-4610-8e6c-8786f93c191a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.635872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bea5b3-50b9-4610-8e6c-8786f93c191a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:12.637604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bea5b3-50b9-4610-8e6c-8786f93c191a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:12.654938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-81bea5b3-50b9-4610-8e6c-8786f93c191a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:12.656750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 241/463] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:12.658243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2add-3d13-49fe-8353-ca2cb109562a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.658728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2add-3d13-49fe-8353-ca2cb109562a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.659221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2add-3d13-49fe-8353-ca2cb109562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.685817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-640b2add-3d13-49fe-8353-ca2cb109562a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:12.687101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-640b2add-3d13-49fe-8353-ca2cb109562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:12.715408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95612e2-f186-466b-80bd-dfa559968ea8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:12.749298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316e0b5-219a-4af2-8b7a-ae50c61907d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:12.749964 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e0b5-219a-4af2-8b7a-ae50c61907d3 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.750248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e0b5-219a-4af2-8b7a-ae50c61907d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.750524 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e0b5-219a-4af2-8b7a-ae50c61907d3 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.751226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316e0b5-219a-4af2-8b7a-ae50c61907d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:12.752649 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316e0b5-219a-4af2-8b7a-ae50c61907d3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:12.761118 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 242/464] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:12.761118 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b2add-3d13-49fe-8353-ca2cb109562a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:12.838952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 223/465] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:06:12 2022] POST /identity/v3/users => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:12.850795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6739-2490-4359-b71e-188e4bfeb55f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.851271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6739-2490-4359-b71e-188e4bfeb55f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.851561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6739-2490-4359-b71e-188e4bfeb55f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.852917 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 224/466] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:12.853935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b6739-2490-4359-b71e-188e4bfeb55f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:12.861428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b2add-3d13-49fe-8353-ca2cb109562a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:12.901999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a3a36-2405-47a9-bd74-bb0669cb5e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:12.903164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a3a36-2405-47a9-bd74-bb0669cb5e03 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.903676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a3a36-2405-47a9-bd74-bb0669cb5e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.904155 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a3a36-2405-47a9-bd74-bb0669cb5e03 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.905138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a3a36-2405-47a9-bd74-bb0669cb5e03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:12.905691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a3a36-2405-47a9-bd74-bb0669cb5e03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:12.907396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a3a36-2405-47a9-bd74-bb0669cb5e03 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:12.921106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 243/467] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:12.922760 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390e4b3-7a83-4d50-8706-aa13b1ebf696 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:12.923259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390e4b3-7a83-4d50-8706-aa13b1ebf696 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:12.923765 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390e4b3-7a83-4d50-8706-aa13b1ebf696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:12.943651 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c390e4b3-7a83-4d50-8706-aa13b1ebf696 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:12.945372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c390e4b3-7a83-4d50-8706-aa13b1ebf696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:12.970821 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b6739-2490-4359-b71e-188e4bfeb55f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:13.009281 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94041df8-9722-4486-8ec7-81798f1356d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:13.010128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041df8-9722-4486-8ec7-81798f1356d9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:13.010470 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041df8-9722-4486-8ec7-81798f1356d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:13.010676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041df8-9722-4486-8ec7-81798f1356d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:13.027427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94041df8-9722-4486-8ec7-81798f1356d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:13.027427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94041df8-9722-4486-8ec7-81798f1356d9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:13.028234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 244/468] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:13.029465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390e4b3-7a83-4d50-8706-aa13b1ebf696 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:13.042434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-94041df8-9722-4486-8ec7-81798f1356d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:13.047839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 225/469] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:13.050076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94041df8-9722-4486-8ec7-81798f1356d9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:13.160140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390e4b3-7a83-4d50-8706-aa13b1ebf696 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:13.176747 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94041df8-9722-4486-8ec7-81798f1356d9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:13.196584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d725543-41cf-48d8-aae2-e09770a9b894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:13.197598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d725543-41cf-48d8-aae2-e09770a9b894 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:13.197884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d725543-41cf-48d8-aae2-e09770a9b894 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:13.198158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d725543-41cf-48d8-aae2-e09770a9b894 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:13.198865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d725543-41cf-48d8-aae2-e09770a9b894 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:13.200308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d725543-41cf-48d8-aae2-e09770a9b894 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:13.215282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fc823-4e95-4042-b3bb-63a263b4b852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:13.216033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fc823-4e95-4042-b3bb-63a263b4b852 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:13.216388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fc823-4e95-4042-b3bb-63a263b4b852 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:13.216738 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fc823-4e95-4042-b3bb-63a263b4b852 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:13.217561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fc823-4e95-4042-b3bb-63a263b4b852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:13.217953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fc823-4e95-4042-b3bb-63a263b4b852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:13.219451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fc823-4e95-4042-b3bb-63a263b4b852 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:13.231236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 226/470] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:13.233097 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fc823-4e95-4042-b3bb-63a263b4b852 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:13.290411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 245/471] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:06:13 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:13.298270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d725543-41cf-48d8-aae2-e09770a9b894 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:13.349543 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fc823-4e95-4042-b3bb-63a263b4b852 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:13.390257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e5483-1eb8-491a-beb9-13a58da8fe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:13.392153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5483-1eb8-491a-beb9-13a58da8fe4b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:13.392593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5483-1eb8-491a-beb9-13a58da8fe4b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:13.393042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5483-1eb8-491a-beb9-13a58da8fe4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:13.407321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e5483-1eb8-491a-beb9-13a58da8fe4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:13.409521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e5483-1eb8-491a-beb9-13a58da8fe4b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:13.429816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-f23e5483-1eb8-491a-beb9-13a58da8fe4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:13.432192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 227/472] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:13.438401 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e5483-1eb8-491a-beb9-13a58da8fe4b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:13.528381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d725543-41cf-48d8-aae2-e09770a9b894 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:13.564547 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e5483-1eb8-491a-beb9-13a58da8fe4b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:13.565187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f712e27-a423-475d-956f-89337ff316f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:13.566029 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f712e27-a423-475d-956f-89337ff316f9 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:13.566980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f712e27-a423-475d-956f-89337ff316f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:13.567399 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f712e27-a423-475d-956f-89337ff316f9 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:13.568343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f712e27-a423-475d-956f-89337ff316f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:13.569973 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f712e27-a423-475d-956f-89337ff316f9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:13.600524 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb3510-bba0-4774-8b67-7af6b6a33fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:13.601209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3510-bba0-4774-8b67-7af6b6a33fab None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:13.601490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3510-bba0-4774-8b67-7af6b6a33fab None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:13.601772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3510-bba0-4774-8b67-7af6b6a33fab None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:13.602484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb3510-bba0-4774-8b67-7af6b6a33fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:13.602790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb3510-bba0-4774-8b67-7af6b6a33fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:13.604270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb3510-bba0-4774-8b67-7af6b6a33fab None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:13.618120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 228/473] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:13.619417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542eb6f-9af1-45f5-88f5-67fa3855782f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:13.619700 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542eb6f-9af1-45f5-88f5-67fa3855782f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:13.619973 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542eb6f-9af1-45f5-88f5-67fa3855782f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:13.621489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 229/474] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:13.625870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542eb6f-9af1-45f5-88f5-67fa3855782f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:13.686582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 246/475] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:06:13 2022] POST /identity/v3/users => generated 248 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:13.693580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de52c23-49eb-47a2-bbcf-b68482004d83 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:13.693580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de52c23-49eb-47a2-bbcf-b68482004d83 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:13.693580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de52c23-49eb-47a2-bbcf-b68482004d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:13.727362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5de52c23-49eb-47a2-bbcf-b68482004d83 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:13.728602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5de52c23-49eb-47a2-bbcf-b68482004d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:13.778769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542eb6f-9af1-45f5-88f5-67fa3855782f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:13.820794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 247/476] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:13.839751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb1c87-1339-482d-bbf2-f12741bc3499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:13.840835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb1c87-1339-482d-bbf2-f12741bc3499 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:13.841353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb1c87-1339-482d-bbf2-f12741bc3499 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:13.841822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb1c87-1339-482d-bbf2-f12741bc3499 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:13.842740 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb1c87-1339-482d-bbf2-f12741bc3499 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:13.844414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb1c87-1339-482d-bbf2-f12741bc3499 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:13.855900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de52c23-49eb-47a2-bbcf-b68482004d83 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:13.934261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 230/477] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:06:13 2022] POST /identity/v3/users => generated 249 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:13.985006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de52c23-49eb-47a2-bbcf-b68482004d83 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:14.034768 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad55edc-54cf-4a39-b2c2-7cefa0180614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:14.035988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad55edc-54cf-4a39-b2c2-7cefa0180614 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:14.036275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad55edc-54cf-4a39-b2c2-7cefa0180614 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:14.036553 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad55edc-54cf-4a39-b2c2-7cefa0180614 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:14.037439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad55edc-54cf-4a39-b2c2-7cefa0180614 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:14.038844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad55edc-54cf-4a39-b2c2-7cefa0180614 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:14.085870 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.sql.core [None req-2ad55edc-54cf-4a39-b2c2-7cefa0180614 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 12 14:06:14.085870 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 12 14:06:14.085870 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [parameters: {'id': 'b7c59f1cfb6c4b57961a5a7d44c2d54e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 12 14:06:14.085870 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80175) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 14:06:14.101920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-2ad55edc-54cf-4a39-b2c2-7cefa0180614 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 12 14:06:14.106533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 248/478] 10.222.0.61 () {60 vars in 1131 bytes} [Tue Apr 12 14:06:13 2022] POST /identity/v3/roles => generated 144 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:14.109525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb1c87-1339-482d-bbf2-f12741bc3499 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:14.234207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb1c87-1339-482d-bbf2-f12741bc3499 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:14.272569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740106b-47af-4f8c-9109-1da164585bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:14.273704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740106b-47af-4f8c-9109-1da164585bbd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:14.274217 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740106b-47af-4f8c-9109-1da164585bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:14.274672 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740106b-47af-4f8c-9109-1da164585bbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:14.286177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740106b-47af-4f8c-9109-1da164585bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:14.293667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-d740106b-47af-4f8c-9109-1da164585bbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 14:06:14.295389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 231/479] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:06:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:14.301440 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad55edc-54cf-4a39-b2c2-7cefa0180614 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:14.404414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad55edc-54cf-4a39-b2c2-7cefa0180614 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:14.437689 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e0053-36ad-446a-8683-543ae8bd01e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:14.438696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e0053-36ad-446a-8683-543ae8bd01e9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:14.439033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e0053-36ad-446a-8683-543ae8bd01e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:14.439310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e0053-36ad-446a-8683-543ae8bd01e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:14.440052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e0053-36ad-446a-8683-543ae8bd01e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:14.440354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e0053-36ad-446a-8683-543ae8bd01e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:14.442380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e0053-36ad-446a-8683-543ae8bd01e9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:14.451016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 249/480] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:15.389343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd0593-fcfe-48c8-b97d-b95b3e024636 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:15.389884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd0593-fcfe-48c8-b97d-b95b3e024636 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:15.389884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd0593-fcfe-48c8-b97d-b95b3e024636 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:15.391507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 232/481] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:15.397588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561676a7-369e-4194-9128-1dcc39a2343a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:15.397996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561676a7-369e-4194-9128-1dcc39a2343a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:15.398162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561676a7-369e-4194-9128-1dcc39a2343a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:15.415479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-561676a7-369e-4194-9128-1dcc39a2343a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:15.416669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-561676a7-369e-4194-9128-1dcc39a2343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:15.489074 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 250/482] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:06:15.509208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd0593-fcfe-48c8-b97d-b95b3e024636 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:15.612475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd0593-fcfe-48c8-b97d-b95b3e024636 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:15.649700 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dabce-65a4-4ea4-bbaa-3125b2625f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:15.650427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dabce-65a4-4ea4-bbaa-3125b2625f84 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:15.650707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dabce-65a4-4ea4-bbaa-3125b2625f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:15.650981 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dabce-65a4-4ea4-bbaa-3125b2625f84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:15.663896 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dabce-65a4-4ea4-bbaa-3125b2625f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:15.673208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-726dabce-65a4-4ea4-bbaa-3125b2625f84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:15.681002 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 233/483] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:15.681190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561676a7-369e-4194-9128-1dcc39a2343a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:15.779727 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561676a7-369e-4194-9128-1dcc39a2343a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:15.815447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9106b-30e4-4238-8014-6c91ec027380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:15.816665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9106b-30e4-4238-8014-6c91ec027380 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:15.817098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9106b-30e4-4238-8014-6c91ec027380 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:15.817380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9106b-30e4-4238-8014-6c91ec027380 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:15.818129 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9106b-30e4-4238-8014-6c91ec027380 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:15.818441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9106b-30e4-4238-8014-6c91ec027380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:15.819820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9106b-30e4-4238-8014-6c91ec027380 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:15.832806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 251/484] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:15.834194 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dabce-65a4-4ea4-bbaa-3125b2625f84 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:15.934464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dabce-65a4-4ea4-bbaa-3125b2625f84 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:15.968136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2f7b7-c8a1-473d-b6b8-250f2e7d1c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:15.968928 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2f7b7-c8a1-473d-b6b8-250f2e7d1c9c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:15.969242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2f7b7-c8a1-473d-b6b8-250f2e7d1c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:15.969515 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2f7b7-c8a1-473d-b6b8-250f2e7d1c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:15.980252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2f7b7-c8a1-473d-b6b8-250f2e7d1c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:15.981822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2f7b7-c8a1-473d-b6b8-250f2e7d1c9c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:15.998695 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-23a2f7b7-c8a1-473d-b6b8-250f2e7d1c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:16.005014 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 234/485] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:16.006361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9106b-30e4-4238-8014-6c91ec027380 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:16.061246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30e3d5-85dc-4a50-bf91-846ac20dc929 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:16.061881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30e3d5-85dc-4a50-bf91-846ac20dc929 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:16.062373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30e3d5-85dc-4a50-bf91-846ac20dc929 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:16.064174 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 235/486] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:16.070035 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20253d5-9afb-4432-8f53-4169f471b2b9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:16.070557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20253d5-9afb-4432-8f53-4169f471b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:16.071047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20253d5-9afb-4432-8f53-4169f471b2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:16.098726 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f20253d5-9afb-4432-8f53-4169f471b2b9 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:16.100275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f20253d5-9afb-4432-8f53-4169f471b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:16.111101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9106b-30e4-4238-8014-6c91ec027380 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:16.148516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5f24b-86ad-45ca-a8c6-e665dd186fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:16.149214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5f24b-86ad-45ca-a8c6-e665dd186fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:16.149508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5f24b-86ad-45ca-a8c6-e665dd186fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:16.149777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5f24b-86ad-45ca-a8c6-e665dd186fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:16.150507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5f24b-86ad-45ca-a8c6-e665dd186fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:16.150808 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5f24b-86ad-45ca-a8c6-e665dd186fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:16.152499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5f24b-86ad-45ca-a8c6-e665dd186fd2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:16.170459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 252/487] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:16.171850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5f24b-86ad-45ca-a8c6-e665dd186fd2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:16.271046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 236/488] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:06:16.281838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5f24b-86ad-45ca-a8c6-e665dd186fd2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:16.307469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20253d5-9afb-4432-8f53-4169f471b2b9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:16.318547 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767af422-8ec2-4b3b-aae9-c84740f5818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:16.319361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767af422-8ec2-4b3b-aae9-c84740f5818e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:16.319640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767af422-8ec2-4b3b-aae9-c84740f5818e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:16.319913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767af422-8ec2-4b3b-aae9-c84740f5818e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:16.328380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767af422-8ec2-4b3b-aae9-c84740f5818e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:16.330152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767af422-8ec2-4b3b-aae9-c84740f5818e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:16.345574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-767af422-8ec2-4b3b-aae9-c84740f5818e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 14:06:16.352941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 253/489] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Apr 12 14:06:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:16.354378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767af422-8ec2-4b3b-aae9-c84740f5818e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:16.477490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767af422-8ec2-4b3b-aae9-c84740f5818e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:16.512647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc74e36-1b47-4804-bae0-12dcc2303d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:16.513354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc74e36-1b47-4804-bae0-12dcc2303d18 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:16.513640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc74e36-1b47-4804-bae0-12dcc2303d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:16.513913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc74e36-1b47-4804-bae0-12dcc2303d18 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:16.514755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc74e36-1b47-4804-bae0-12dcc2303d18 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:16.515067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc74e36-1b47-4804-bae0-12dcc2303d18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:16.516493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc74e36-1b47-4804-bae0-12dcc2303d18 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:16.555490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 254/490] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Apr 12 14:06:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:16.556058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20253d5-9afb-4432-8f53-4169f471b2b9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:16.561745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc74e36-1b47-4804-bae0-12dcc2303d18 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:16.599173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce6098-0b30-4aba-80b8-df35cdf301bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:16.599980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce6098-0b30-4aba-80b8-df35cdf301bd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:16.600267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce6098-0b30-4aba-80b8-df35cdf301bd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:16.600541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce6098-0b30-4aba-80b8-df35cdf301bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:16.629925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce6098-0b30-4aba-80b8-df35cdf301bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:16.636927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-2cce6098-0b30-4aba-80b8-df35cdf301bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:16.638465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 237/491] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:16.643892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce6098-0b30-4aba-80b8-df35cdf301bd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:16.736607 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc74e36-1b47-4804-bae0-12dcc2303d18 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:16.818099 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce6098-0b30-4aba-80b8-df35cdf301bd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:16.825710 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9f2bf-4f3e-41d4-8e98-37a8062b8b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:16.826378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f2bf-4f3e-41d4-8e98-37a8062b8b82 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:16.826661 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f2bf-4f3e-41d4-8e98-37a8062b8b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:16.826935 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f2bf-4f3e-41d4-8e98-37a8062b8b82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:16.858128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646f08d-bd1f-48e2-99e0-b59ced7557a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:16.858906 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f08d-bd1f-48e2-99e0-b59ced7557a9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:16.859197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f08d-bd1f-48e2-99e0-b59ced7557a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:16.859469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f08d-bd1f-48e2-99e0-b59ced7557a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:16.860213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646f08d-bd1f-48e2-99e0-b59ced7557a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:16.860519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646f08d-bd1f-48e2-99e0-b59ced7557a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:16.861921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646f08d-bd1f-48e2-99e0-b59ced7557a9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:16.871643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 238/492] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:16.872986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cddd0-bc09-48d2-ac28-2fb9500bf66e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:16.877456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cddd0-bc09-48d2-ac28-2fb9500bf66e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:16.877747 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cddd0-bc09-48d2-ac28-2fb9500bf66e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:16.879808 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 239/493] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:16.884564 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cddd0-bc09-48d2-ac28-2fb9500bf66e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:16.915444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9f2bf-4f3e-41d4-8e98-37a8062b8b82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:16.917250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9f2bf-4f3e-41d4-8e98-37a8062b8b82 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:16.988203 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cddd0-bc09-48d2-ac28-2fb9500bf66e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:17.018681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 255/494] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:17.020778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcaf40-c0de-447a-9050-487a28cf36bb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.021231 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcaf40-c0de-447a-9050-487a28cf36bb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.021873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcaf40-c0de-447a-9050-487a28cf36bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.025389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a809b5-6157-4b3f-818b-5c19f953605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:17.026332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a809b5-6157-4b3f-818b-5c19f953605e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.026710 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a809b5-6157-4b3f-818b-5c19f953605e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.027079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a809b5-6157-4b3f-818b-5c19f953605e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.039897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e5dcaf40-c0de-447a-9050-487a28cf36bb None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:17.040304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a809b5-6157-4b3f-818b-5c19f953605e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:17.041470 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e5dcaf40-c0de-447a-9050-487a28cf36bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:17.042070 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a809b5-6157-4b3f-818b-5c19f953605e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:17.060144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-59a809b5-6157-4b3f-818b-5c19f953605e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:17.066751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 240/495] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:17.067775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a809b5-6157-4b3f-818b-5c19f953605e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:17.111063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 256/496] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:17.112217 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcaf40-c0de-447a-9050-487a28cf36bb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:17.186654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a809b5-6157-4b3f-818b-5c19f953605e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:17.212338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcaf40-c0de-447a-9050-487a28cf36bb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:17.224944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ce54b-06ff-4d47-aed4-05b0b324fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:17.225879 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ce54b-06ff-4d47-aed4-05b0b324fea6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.226170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ce54b-06ff-4d47-aed4-05b0b324fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.226442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ce54b-06ff-4d47-aed4-05b0b324fea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.236555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ce54b-06ff-4d47-aed4-05b0b324fea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:17.240927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ce54b-06ff-4d47-aed4-05b0b324fea6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:17.246298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b65f8-e6c4-4237-936b-87bd30c119e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:17.246969 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b65f8-e6c4-4237-936b-87bd30c119e8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.247258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b65f8-e6c4-4237-936b-87bd30c119e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.247535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b65f8-e6c4-4237-936b-87bd30c119e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.248289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b65f8-e6c4-4237-936b-87bd30c119e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:17.248618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b65f8-e6c4-4237-936b-87bd30c119e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:17.250027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b65f8-e6c4-4237-936b-87bd30c119e8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:17.257161 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-857ce54b-06ff-4d47-aed4-05b0b324fea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:17.261284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 241/497] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:17.266383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea9327-4842-4d9c-b03c-08526903ed4c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.266383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea9327-4842-4d9c-b03c-08526903ed4c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.266383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea9327-4842-4d9c-b03c-08526903ed4c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.266383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 242/498] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:17.266383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea9327-4842-4d9c-b03c-08526903ed4c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:17.266939 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 257/499] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:17.267986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b65f8-e6c4-4237-936b-87bd30c119e8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:17.369181 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea9327-4842-4d9c-b03c-08526903ed4c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:17.374617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b65f8-e6c4-4237-936b-87bd30c119e8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:17.402246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d694605-c2fe-498e-ae22-e193b073993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:17.403054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d694605-c2fe-498e-ae22-e193b073993a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.403416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d694605-c2fe-498e-ae22-e193b073993a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.403600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d694605-c2fe-498e-ae22-e193b073993a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.408841 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2a3b9-4e39-4019-bce0-258d442c5c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:17.409892 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a3b9-4e39-4019-bce0-258d442c5c4a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.410581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a3b9-4e39-4019-bce0-258d442c5c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.411047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a3b9-4e39-4019-bce0-258d442c5c4a None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.412006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2a3b9-4e39-4019-bce0-258d442c5c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:17.412504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2a3b9-4e39-4019-bce0-258d442c5c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:17.413891 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d694605-c2fe-498e-ae22-e193b073993a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:17.414354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2a3b9-4e39-4019-bce0-258d442c5c4a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:17.420757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-5d694605-c2fe-498e-ae22-e193b073993a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:17.422136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 243/500] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:17.422720 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d694605-c2fe-498e-ae22-e193b073993a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:17.427866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 258/501] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:17.429369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ebdde-e6f9-4fbc-9ece-6d9272196815 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.429843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ebdde-e6f9-4fbc-9ece-6d9272196815 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.430118 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ebdde-e6f9-4fbc-9ece-6d9272196815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.447169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-399ebdde-e6f9-4fbc-9ece-6d9272196815 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:17.448324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-399ebdde-e6f9-4fbc-9ece-6d9272196815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:17.513571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 259/502] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:17.515099 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ebdde-e6f9-4fbc-9ece-6d9272196815 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:17.551557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d694605-c2fe-498e-ae22-e193b073993a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:17.585632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad882c80-2400-420a-88f6-93e8242516e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:17.586424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad882c80-2400-420a-88f6-93e8242516e7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.586703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad882c80-2400-420a-88f6-93e8242516e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.586979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad882c80-2400-420a-88f6-93e8242516e7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.594355 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad882c80-2400-420a-88f6-93e8242516e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:17.595804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad882c80-2400-420a-88f6-93e8242516e7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:17.608979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-ad882c80-2400-420a-88f6-93e8242516e7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 14:06:17.610171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 244/503] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:17.610920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad882c80-2400-420a-88f6-93e8242516e7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:17.615906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ebdde-e6f9-4fbc-9ece-6d9272196815 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:17.648592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ecfc4-3beb-4eb3-800a-c86b6a7f6147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:17.649204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ecfc4-3beb-4eb3-800a-c86b6a7f6147 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.649485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ecfc4-3beb-4eb3-800a-c86b6a7f6147 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.649758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ecfc4-3beb-4eb3-800a-c86b6a7f6147 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.650491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ecfc4-3beb-4eb3-800a-c86b6a7f6147 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:17.650796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ecfc4-3beb-4eb3-800a-c86b6a7f6147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:17.652165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ecfc4-3beb-4eb3-800a-c86b6a7f6147 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:17.659882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 260/504] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:17.660732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ecfc4-3beb-4eb3-800a-c86b6a7f6147 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:17.710714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad882c80-2400-420a-88f6-93e8242516e7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:17.742370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873388f-2834-4a6e-a262-da8a006869da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:17.743147 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873388f-2834-4a6e-a262-da8a006869da None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.743423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873388f-2834-4a6e-a262-da8a006869da None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.743688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873388f-2834-4a6e-a262-da8a006869da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.750122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873388f-2834-4a6e-a262-da8a006869da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:17.751565 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873388f-2834-4a6e-a262-da8a006869da None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:17.755176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ecfc4-3beb-4eb3-800a-c86b6a7f6147 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:17.766031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-5873388f-2834-4a6e-a262-da8a006869da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:17.767181 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 245/505] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:17.768357 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49c38a-0d3a-4b2b-804d-88f3389dd5dc None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.768637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49c38a-0d3a-4b2b-804d-88f3389dd5dc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.769496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49c38a-0d3a-4b2b-804d-88f3389dd5dc None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.772744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 246/506] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:17.772744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49c38a-0d3a-4b2b-804d-88f3389dd5dc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:17.788119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fae673-55d7-4e45-adad-c406b955e8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:17.788912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fae673-55d7-4e45-adad-c406b955e8cd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.789224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fae673-55d7-4e45-adad-c406b955e8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.789500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fae673-55d7-4e45-adad-c406b955e8cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.799131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fae673-55d7-4e45-adad-c406b955e8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:17.806054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-74fae673-55d7-4e45-adad-c406b955e8cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:17.807231 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 261/507] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:17.807986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fae673-55d7-4e45-adad-c406b955e8cd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:17.868177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49c38a-0d3a-4b2b-804d-88f3389dd5dc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:17.900990 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec0857-3923-4450-bee8-a28b52b2e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:17.901583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0857-3923-4450-bee8-a28b52b2e1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.901857 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0857-3923-4450-bee8-a28b52b2e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.902130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0857-3923-4450-bee8-a28b52b2e1d9 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.902950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec0857-3923-4450-bee8-a28b52b2e1d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:17.903254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec0857-3923-4450-bee8-a28b52b2e1d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:17.904689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec0857-3923-4450-bee8-a28b52b2e1d9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:17.906109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fae673-55d7-4e45-adad-c406b955e8cd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:17.937242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81cf60-ecc2-444d-af2d-d0fe5daf5d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:17.938021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81cf60-ecc2-444d-af2d-d0fe5daf5d24 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.938306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81cf60-ecc2-444d-af2d-d0fe5daf5d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.938582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81cf60-ecc2-444d-af2d-d0fe5daf5d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.939846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 247/508] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Apr 12 14:06:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:17.940647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec0857-3923-4450-bee8-a28b52b2e1d9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:17.950056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81cf60-ecc2-444d-af2d-d0fe5daf5d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:17.951503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81cf60-ecc2-444d-af2d-d0fe5daf5d24 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:17.967891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-3e81cf60-ecc2-444d-af2d-d0fe5daf5d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:17.969262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 262/509] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:17.970267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa87ee9-207c-4b02-bcbb-4e44cf8837b5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:17.970554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa87ee9-207c-4b02-bcbb-4e44cf8837b5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:17.970835 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa87ee9-207c-4b02-bcbb-4e44cf8837b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:17.986289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8fa87ee9-207c-4b02-bcbb-4e44cf8837b5 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:17.987491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8fa87ee9-207c-4b02-bcbb-4e44cf8837b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:18.040185 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec0857-3923-4450-bee8-a28b52b2e1d9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.049846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 263/510] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:18.050918 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa87ee9-207c-4b02-bcbb-4e44cf8837b5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:18.085265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b11c5-8f40-4264-960a-7329c2e91601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:18.085930 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b11c5-8f40-4264-960a-7329c2e91601 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:18.086212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b11c5-8f40-4264-960a-7329c2e91601 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:18.086513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b11c5-8f40-4264-960a-7329c2e91601 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:18.087274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b11c5-8f40-4264-960a-7329c2e91601 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:18.087590 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b11c5-8f40-4264-960a-7329c2e91601 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:18.089045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b11c5-8f40-4264-960a-7329c2e91601 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:18.106361 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 248/511] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:18.107155 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b11c5-8f40-4264-960a-7329c2e91601 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:18.149615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa87ee9-207c-4b02-bcbb-4e44cf8837b5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.181473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1c27e-9a1b-4e29-ba24-0fa6b21bac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:18.182137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1c27e-9a1b-4e29-ba24-0fa6b21bac08 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:18.182417 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1c27e-9a1b-4e29-ba24-0fa6b21bac08 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:18.182689 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1c27e-9a1b-4e29-ba24-0fa6b21bac08 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:18.183425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1c27e-9a1b-4e29-ba24-0fa6b21bac08 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:18.183736 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1c27e-9a1b-4e29-ba24-0fa6b21bac08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:18.185140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1c27e-9a1b-4e29-ba24-0fa6b21bac08 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:18.193254 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 264/512] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:18.194025 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1c27e-9a1b-4e29-ba24-0fa6b21bac08 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:18.205816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b11c5-8f40-4264-960a-7329c2e91601 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.238072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bba7f6-9828-4293-a647-aeeef3eae7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:18.238995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bba7f6-9828-4293-a647-aeeef3eae7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:18.239283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bba7f6-9828-4293-a647-aeeef3eae7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:18.239561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bba7f6-9828-4293-a647-aeeef3eae7d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:18.287717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1c27e-9a1b-4e29-ba24-0fa6b21bac08 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.303194 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bba7f6-9828-4293-a647-aeeef3eae7d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:18.304648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bba7f6-9828-4293-a647-aeeef3eae7d3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:18.319881 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f5b00-c565-406f-9eb5-239b4f3d7cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:18.320534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5b00-c565-406f-9eb5-239b4f3d7cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:18.320819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5b00-c565-406f-9eb5-239b4f3d7cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:18.321127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5b00-c565-406f-9eb5-239b4f3d7cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:18.322096 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f5b00-c565-406f-9eb5-239b4f3d7cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:18.322402 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f5b00-c565-406f-9eb5-239b4f3d7cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:18.323815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f5b00-c565-406f-9eb5-239b4f3d7cc2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:18.335708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 265/513] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:18.336565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f5b00-c565-406f-9eb5-239b4f3d7cc2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:18.399197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 249/514] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:18.400032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bba7f6-9828-4293-a647-aeeef3eae7d3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:18.433547 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f5b00-c565-406f-9eb5-239b4f3d7cc2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.465717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79f596-4070-4f03-b842-221767da6542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:18.466510 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f596-4070-4f03-b842-221767da6542 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:18.466793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f596-4070-4f03-b842-221767da6542 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:18.467283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f596-4070-4f03-b842-221767da6542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:18.477276 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79f596-4070-4f03-b842-221767da6542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:18.478710 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79f596-4070-4f03-b842-221767da6542 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:18.493913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bba7f6-9828-4293-a647-aeeef3eae7d3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.494504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-bc79f596-4070-4f03-b842-221767da6542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:18.495807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 266/515] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:18.496568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79f596-4070-4f03-b842-221767da6542 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:18.526513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169eb55-0b7c-41b9-ba2c-b1df7ad4b608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:18.527151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169eb55-0b7c-41b9-ba2c-b1df7ad4b608 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:18.527427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169eb55-0b7c-41b9-ba2c-b1df7ad4b608 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:18.527694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169eb55-0b7c-41b9-ba2c-b1df7ad4b608 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:18.528512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169eb55-0b7c-41b9-ba2c-b1df7ad4b608 None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=b9933c6dc8f74cd59f6a1f8c11abf652) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:18.528821 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169eb55-0b7c-41b9-ba2c-b1df7ad4b608 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:18.530279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169eb55-0b7c-41b9-ba2c-b1df7ad4b608 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:18.535566 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 250/516] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:18 2022] GET /identity/v3/role_assignments?user.id=b9933c6dc8f74cd59f6a1f8c11abf652&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:18.536323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169eb55-0b7c-41b9-ba2c-b1df7ad4b608 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:18.602255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79f596-4070-4f03-b842-221767da6542 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.639793 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169eb55-0b7c-41b9-ba2c-b1df7ad4b608 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.641181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d3ea5-afd7-49dc-8d9b-32ffba7ade90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:18.641994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d3ea5-afd7-49dc-8d9b-32ffba7ade90 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:18.642282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d3ea5-afd7-49dc-8d9b-32ffba7ade90 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:18.642551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d3ea5-afd7-49dc-8d9b-32ffba7ade90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:18.653403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d3ea5-afd7-49dc-8d9b-32ffba7ade90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:18.654876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d3ea5-afd7-49dc-8d9b-32ffba7ade90 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:18.675161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-b60d3ea5-afd7-49dc-8d9b-32ffba7ade90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:18.677349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 267/517] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:18.677984 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d3ea5-afd7-49dc-8d9b-32ffba7ade90 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:18.688730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd78913-2c62-483c-b2cc-34697451aa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:18.689538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78913-2c62-483c-b2cc-34697451aa67 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:18.690230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78913-2c62-483c-b2cc-34697451aa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:18.690230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78913-2c62-483c-b2cc-34697451aa67 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:18.699893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd78913-2c62-483c-b2cc-34697451aa67 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:18.701429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd78913-2c62-483c-b2cc-34697451aa67 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:18.716512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-2cd78913-2c62-483c-b2cc-34697451aa67 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 14:06:18.717769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 251/518] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:18.718553 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd78913-2c62-483c-b2cc-34697451aa67 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:18.784244 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d3ea5-afd7-49dc-8d9b-32ffba7ade90 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.817780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2987f-edd4-4e8b-a201-1093c6aa4d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:18.818570 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2987f-edd4-4e8b-a201-1093c6aa4d10 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:18.818854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2987f-edd4-4e8b-a201-1093c6aa4d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:18.819128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2987f-edd4-4e8b-a201-1093c6aa4d10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:18.823272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd78913-2c62-483c-b2cc-34697451aa67 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.829164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2987f-edd4-4e8b-a201-1093c6aa4d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:18.830632 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2987f-edd4-4e8b-a201-1093c6aa4d10 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:18.848225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-14b2987f-edd4-4e8b-a201-1093c6aa4d10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:18.849484 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 268/519] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:18.850252 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2987f-edd4-4e8b-a201-1093c6aa4d10 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:18.861502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34565aef-dcb0-4706-89d7-2bb818085f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:18.862430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34565aef-dcb0-4706-89d7-2bb818085f64 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:18.863632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34565aef-dcb0-4706-89d7-2bb818085f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:18.864137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34565aef-dcb0-4706-89d7-2bb818085f64 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:18.864856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34565aef-dcb0-4706-89d7-2bb818085f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:18.865189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34565aef-dcb0-4706-89d7-2bb818085f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:18.866571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34565aef-dcb0-4706-89d7-2bb818085f64 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:18.879913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 252/520] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:18.880808 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34565aef-dcb0-4706-89d7-2bb818085f64 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:18.953972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2987f-edd4-4e8b-a201-1093c6aa4d10 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.982218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34565aef-dcb0-4706-89d7-2bb818085f64 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:18.985495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8da18-a192-43b9-97f8-ceb61b2167d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:18.986156 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8da18-a192-43b9-97f8-ceb61b2167d0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:18.986438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8da18-a192-43b9-97f8-ceb61b2167d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:18.986710 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8da18-a192-43b9-97f8-ceb61b2167d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:18.987423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8da18-a192-43b9-97f8-ceb61b2167d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:18.988302 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8da18-a192-43b9-97f8-ceb61b2167d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:18.989713 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8da18-a192-43b9-97f8-ceb61b2167d0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:19.000824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 269/521] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:19.006111 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8da18-a192-43b9-97f8-ceb61b2167d0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:19.017068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5de0d5-a969-4853-a8ee-0e869071633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:19.018046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de0d5-a969-4853-a8ee-0e869071633e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:19.018474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de0d5-a969-4853-a8ee-0e869071633e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:19.019413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de0d5-a969-4853-a8ee-0e869071633e None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:19.020254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5de0d5-a969-4853-a8ee-0e869071633e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:19.020728 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5de0d5-a969-4853-a8ee-0e869071633e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:19.022847 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5de0d5-a969-4853-a8ee-0e869071633e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:19.043576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 253/522] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Apr 12 14:06:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:19.044748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5de0d5-a969-4853-a8ee-0e869071633e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:19.111331 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8da18-a192-43b9-97f8-ceb61b2167d0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:19.144811 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5de0d5-a969-4853-a8ee-0e869071633e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:19.146154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cc25b-de1a-422f-ab7b-bcf10be9e90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:19.146889 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cc25b-de1a-422f-ab7b-bcf10be9e90f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:19.147175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cc25b-de1a-422f-ab7b-bcf10be9e90f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:19.147450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cc25b-de1a-422f-ab7b-bcf10be9e90f None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:19.148166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cc25b-de1a-422f-ab7b-bcf10be9e90f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:19.148472 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cc25b-de1a-422f-ab7b-bcf10be9e90f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:19.149854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cc25b-de1a-422f-ab7b-bcf10be9e90f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:19.161277 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 270/523] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:19.162309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cc25b-de1a-422f-ab7b-bcf10be9e90f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:19.183231 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc80d54-1b2f-4715-9391-ca9595a76e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:19.183968 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc80d54-1b2f-4715-9391-ca9595a76e1d None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:19.184256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc80d54-1b2f-4715-9391-ca9595a76e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:19.184527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc80d54-1b2f-4715-9391-ca9595a76e1d None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:19.185289 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc80d54-1b2f-4715-9391-ca9595a76e1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:19.186717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc80d54-1b2f-4715-9391-ca9595a76e1d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:19.258274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cc25b-de1a-422f-ab7b-bcf10be9e90f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:19.290716 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 254/524] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:06:19 2022] POST /identity/v3/users => generated 247 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:19.291549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc80d54-1b2f-4715-9391-ca9595a76e1d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:19.295243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72e72-0651-438a-bb69-9a806c97b510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:19.296128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72e72-0651-438a-bb69-9a806c97b510 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:19.296411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72e72-0651-438a-bb69-9a806c97b510 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:19.296685 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72e72-0651-438a-bb69-9a806c97b510 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:19.306882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a72e72-0651-438a-bb69-9a806c97b510 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:19.309200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a72e72-0651-438a-bb69-9a806c97b510 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:19.329594 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-b5a72e72-0651-438a-bb69-9a806c97b510 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 14:06:19.335954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 271/525] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:19.335954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72e72-0651-438a-bb69-9a806c97b510 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:19.430011 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc80d54-1b2f-4715-9391-ca9595a76e1d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:19.453046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72e72-0651-438a-bb69-9a806c97b510 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:19.467131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13213e-321a-47d4-afe6-b2ba193e49e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:19.467994 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13213e-321a-47d4-afe6-b2ba193e49e9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:19.468480 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13213e-321a-47d4-afe6-b2ba193e49e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:19.468828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13213e-321a-47d4-afe6-b2ba193e49e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:19.492820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5988-71d6-472a-8607-bd065bcf433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:19.493952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5988-71d6-472a-8607-bd065bcf433d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:19.494241 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5988-71d6-472a-8607-bd065bcf433d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:19.494516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5988-71d6-472a-8607-bd065bcf433d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:19.501624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c5988-71d6-472a-8607-bd065bcf433d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:19.504588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c5988-71d6-472a-8607-bd065bcf433d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:19.518143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-a32c5988-71d6-472a-8607-bd065bcf433d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:19.525125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 272/526] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:19.525125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5988-71d6-472a-8607-bd065bcf433d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:19.542319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13213e-321a-47d4-afe6-b2ba193e49e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:19.543789 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13213e-321a-47d4-afe6-b2ba193e49e9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:19.626260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5988-71d6-472a-8607-bd065bcf433d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:19.646511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 255/527] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:19.652310 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13213e-321a-47d4-afe6-b2ba193e49e9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:19.663754 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8538b3-8672-4bb5-a78a-44ae47cabd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:19.663754 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8538b3-8672-4bb5-a78a-44ae47cabd91 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:19.663754 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8538b3-8672-4bb5-a78a-44ae47cabd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:19.663754 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8538b3-8672-4bb5-a78a-44ae47cabd91 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:19.664142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8538b3-8672-4bb5-a78a-44ae47cabd91 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:19.664142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8538b3-8672-4bb5-a78a-44ae47cabd91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:19.664932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8538b3-8672-4bb5-a78a-44ae47cabd91 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:19.689846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 273/528] 10.222.0.61 () {56 vars in 1139 bytes} [Tue Apr 12 14:06:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:19.689846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8538b3-8672-4bb5-a78a-44ae47cabd91 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:19.774965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13213e-321a-47d4-afe6-b2ba193e49e9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:19.788598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8538b3-8672-4bb5-a78a-44ae47cabd91 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:19.809593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca803f-1a27-46d1-9f0d-2b8afbea9bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:19.810284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca803f-1a27-46d1-9f0d-2b8afbea9bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:19.810570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca803f-1a27-46d1-9f0d-2b8afbea9bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:19.810854 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca803f-1a27-46d1-9f0d-2b8afbea9bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:19.811698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca803f-1a27-46d1-9f0d-2b8afbea9bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:19.812011 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca803f-1a27-46d1-9f0d-2b8afbea9bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:19.813529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca803f-1a27-46d1-9f0d-2b8afbea9bd5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:19.824162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc1f2-234a-4ae6-8df7-7adc2bf0b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:19.824979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc1f2-234a-4ae6-8df7-7adc2bf0b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:19.825276 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc1f2-234a-4ae6-8df7-7adc2bf0b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:19.825555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc1f2-234a-4ae6-8df7-7adc2bf0b3b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:19.826391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 256/529] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:19.827279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca803f-1a27-46d1-9f0d-2b8afbea9bd5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:19.840701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fc1f2-234a-4ae6-8df7-7adc2bf0b3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:19.842206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fc1f2-234a-4ae6-8df7-7adc2bf0b3b7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:19.858854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-4a0fc1f2-234a-4ae6-8df7-7adc2bf0b3b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:19.860340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 274/530] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:19.861153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc1f2-234a-4ae6-8df7-7adc2bf0b3b7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:19.927041 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca803f-1a27-46d1-9f0d-2b8afbea9bd5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:19.959941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc1f2-234a-4ae6-8df7-7adc2bf0b3b7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:19.961115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74829e24-cd32-4840-8b59-28c5f8345725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:19.961935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74829e24-cd32-4840-8b59-28c5f8345725 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:19.963792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74829e24-cd32-4840-8b59-28c5f8345725 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:19.964077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74829e24-cd32-4840-8b59-28c5f8345725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:19.995733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec59345-ec09-4b12-a958-65d91d6aa02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:19.996998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec59345-ec09-4b12-a958-65d91d6aa02e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:19.997311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec59345-ec09-4b12-a958-65d91d6aa02e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:19.997589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec59345-ec09-4b12-a958-65d91d6aa02e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:19.998596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec59345-ec09-4b12-a958-65d91d6aa02e None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=21ef8bbd229c488d97f167c810bc7cfd) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:19.999225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec59345-ec09-4b12-a958-65d91d6aa02e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:20.001131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec59345-ec09-4b12-a958-65d91d6aa02e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:20.008643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 275/531] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:19 2022] GET /identity/v3/role_assignments?user.id=21ef8bbd229c488d97f167c810bc7cfd&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:20.009259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec59345-ec09-4b12-a958-65d91d6aa02e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:20.081292 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74829e24-cd32-4840-8b59-28c5f8345725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:20.082735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74829e24-cd32-4840-8b59-28c5f8345725 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:20.265002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec59345-ec09-4b12-a958-65d91d6aa02e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:20.286937 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 257/532] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:20.300989 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74829e24-cd32-4840-8b59-28c5f8345725 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:20.327180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b56132-6a91-47b2-a276-5b8aee51c7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:20.333052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56132-6a91-47b2-a276-5b8aee51c7ba None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:20.333052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56132-6a91-47b2-a276-5b8aee51c7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:20.333052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56132-6a91-47b2-a276-5b8aee51c7ba None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:20.333052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b56132-6a91-47b2-a276-5b8aee51c7ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:20.333052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b56132-6a91-47b2-a276-5b8aee51c7ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:20.333052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b56132-6a91-47b2-a276-5b8aee51c7ba None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:20.364997 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 276/533] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:20.366871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b56132-6a91-47b2-a276-5b8aee51c7ba None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:20.560066 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74829e24-cd32-4840-8b59-28c5f8345725 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:20.600000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b56132-6a91-47b2-a276-5b8aee51c7ba None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:20.626414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca8d81-8f49-474c-87c7-4c0d5fce6467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:20.627645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca8d81-8f49-474c-87c7-4c0d5fce6467 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:20.628314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca8d81-8f49-474c-87c7-4c0d5fce6467 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:20.628848 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca8d81-8f49-474c-87c7-4c0d5fce6467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:20.666772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca8d81-8f49-474c-87c7-4c0d5fce6467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:20.668843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca8d81-8f49-474c-87c7-4c0d5fce6467 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:20.698184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed8a47-47fa-4946-bd3f-440436c5922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:20.699114 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed8a47-47fa-4946-bd3f-440436c5922b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:20.699422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed8a47-47fa-4946-bd3f-440436c5922b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:20.699700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed8a47-47fa-4946-bd3f-440436c5922b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:20.709657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-5cca8d81-8f49-474c-87c7-4c0d5fce6467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:20.711427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed8a47-47fa-4946-bd3f-440436c5922b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:20.711659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 258/534] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:20.716671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca8d81-8f49-474c-87c7-4c0d5fce6467 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:20.718399 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed8a47-47fa-4946-bd3f-440436c5922b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:20.749937 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-1eed8a47-47fa-4946-bd3f-440436c5922b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:20.753618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 277/535] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:20.766724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed8a47-47fa-4946-bd3f-440436c5922b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:20.896001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca8d81-8f49-474c-87c7-4c0d5fce6467 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:20.927130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed8a47-47fa-4946-bd3f-440436c5922b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:20.962763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6763a-c621-44fe-9417-418be07b11cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:20.963776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6763a-c621-44fe-9417-418be07b11cc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:20.964265 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6763a-c621-44fe-9417-418be07b11cc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:20.964729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6763a-c621-44fe-9417-418be07b11cc None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:20.965744 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6763a-c621-44fe-9417-418be07b11cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:20.966264 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6763a-c621-44fe-9417-418be07b11cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:20.968002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6763a-c621-44fe-9417-418be07b11cc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:20.984861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4595e-9d74-43ca-87d4-51131ac66000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:20.985883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4595e-9d74-43ca-87d4-51131ac66000 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:20.986358 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4595e-9d74-43ca-87d4-51131ac66000 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:20.986849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4595e-9d74-43ca-87d4-51131ac66000 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:20.987927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4595e-9d74-43ca-87d4-51131ac66000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:20.988426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4595e-9d74-43ca-87d4-51131ac66000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:20.990016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4595e-9d74-43ca-87d4-51131ac66000 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:21.006678 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 278/536] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:21.008830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f1d2d-30a7-4fff-9bff-5ca3456c1977 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:21.009169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f1d2d-30a7-4fff-9bff-5ca3456c1977 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:21.009452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f1d2d-30a7-4fff-9bff-5ca3456c1977 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:21.014396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 279/537] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:21.014396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f1d2d-30a7-4fff-9bff-5ca3456c1977 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:21.018227 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 259/538] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:21.020121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ab811-2390-4e0d-8c13-439b0fafae6a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:21.020609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ab811-2390-4e0d-8c13-439b0fafae6a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:21.021534 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ab811-2390-4e0d-8c13-439b0fafae6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:21.041589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-234ab811-2390-4e0d-8c13-439b0fafae6a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:21.043478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-234ab811-2390-4e0d-8c13-439b0fafae6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:21.125542 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f1d2d-30a7-4fff-9bff-5ca3456c1977 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:21.136983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 260/539] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:21.136983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ab811-2390-4e0d-8c13-439b0fafae6a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:21.182102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07673f0-ea1a-4507-aaa1-2cb8ce555aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:21.183197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07673f0-ea1a-4507-aaa1-2cb8ce555aba None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:21.183670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07673f0-ea1a-4507-aaa1-2cb8ce555aba None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:21.184135 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07673f0-ea1a-4507-aaa1-2cb8ce555aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:21.185177 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07673f0-ea1a-4507-aaa1-2cb8ce555aba None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=c6ca11a750dc4234b4512e6274ca01a5) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:21.185702 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07673f0-ea1a-4507-aaa1-2cb8ce555aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:21.187321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07673f0-ea1a-4507-aaa1-2cb8ce555aba None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:21.193930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 280/540] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:21 2022] GET /identity/v3/role_assignments?user.id=c6ca11a750dc4234b4512e6274ca01a5&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:21.194962 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07673f0-ea1a-4507-aaa1-2cb8ce555aba None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:21.245485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ab811-2390-4e0d-8c13-439b0fafae6a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:21.287763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0877b2-4b03-49dd-aef7-0eec2083d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:21.288890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0877b2-4b03-49dd-aef7-0eec2083d6cc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:21.289211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0877b2-4b03-49dd-aef7-0eec2083d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:21.289504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0877b2-4b03-49dd-aef7-0eec2083d6cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:21.298265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0877b2-4b03-49dd-aef7-0eec2083d6cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:21.300763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0877b2-4b03-49dd-aef7-0eec2083d6cc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:21.317357 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-4e0877b2-4b03-49dd-aef7-0eec2083d6cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:21.319293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 261/541] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:21.325788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0877b2-4b03-49dd-aef7-0eec2083d6cc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:21.382509 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07673f0-ea1a-4507-aaa1-2cb8ce555aba None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:21.420946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b90be-7c27-4a15-ab53-1859b8c0b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:21.421839 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b90be-7c27-4a15-ab53-1859b8c0b0dd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:21.422133 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b90be-7c27-4a15-ab53-1859b8c0b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:21.422413 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b90be-7c27-4a15-ab53-1859b8c0b0dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:21.436739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b90be-7c27-4a15-ab53-1859b8c0b0dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:21.444931 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-764b90be-7c27-4a15-ab53-1859b8c0b0dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:21.446976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 281/542] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:21.453635 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b90be-7c27-4a15-ab53-1859b8c0b0dd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:21.514331 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0877b2-4b03-49dd-aef7-0eec2083d6cc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:21.570425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114d49d-1dc7-4c57-9ed7-355a527c9172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:21.571629 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114d49d-1dc7-4c57-9ed7-355a527c9172 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:21.572866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114d49d-1dc7-4c57-9ed7-355a527c9172 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:21.573487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114d49d-1dc7-4c57-9ed7-355a527c9172 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:21.575612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114d49d-1dc7-4c57-9ed7-355a527c9172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:21.576809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114d49d-1dc7-4c57-9ed7-355a527c9172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:21.578438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114d49d-1dc7-4c57-9ed7-355a527c9172 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:21.591592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 262/543] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:21.597689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114d49d-1dc7-4c57-9ed7-355a527c9172 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:21.607739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b90be-7c27-4a15-ab53-1859b8c0b0dd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:21.701762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e18bf5-701d-4892-8898-0d140199a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:21.702378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18bf5-701d-4892-8898-0d140199a600 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:21.702639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18bf5-701d-4892-8898-0d140199a600 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:21.702920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18bf5-701d-4892-8898-0d140199a600 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:21.703673 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e18bf5-701d-4892-8898-0d140199a600 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:21.703986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e18bf5-701d-4892-8898-0d140199a600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:21.705440 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e18bf5-701d-4892-8898-0d140199a600 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:21.708396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114d49d-1dc7-4c57-9ed7-355a527c9172 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:21.733769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 282/544] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:21.751450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e18bf5-701d-4892-8898-0d140199a600 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:21.772719 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c260d7-ea25-4070-99db-158f37c1d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:21.774597 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c260d7-ea25-4070-99db-158f37c1d4be None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:21.774879 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c260d7-ea25-4070-99db-158f37c1d4be None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:21.775163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c260d7-ea25-4070-99db-158f37c1d4be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:21.777663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c260d7-ea25-4070-99db-158f37c1d4be None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=fa7ee0856f4644c994c3ccbd400b6fbb) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:21.778207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c260d7-ea25-4070-99db-158f37c1d4be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:21.779845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c260d7-ea25-4070-99db-158f37c1d4be None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:21.795241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 263/545] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:21 2022] GET /identity/v3/role_assignments?user.id=fa7ee0856f4644c994c3ccbd400b6fbb&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:21.866236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e18bf5-701d-4892-8898-0d140199a600 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:21.901352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db47fd-cb1d-4cf6-b7a7-af2dc703e78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:21.902146 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db47fd-cb1d-4cf6-b7a7-af2dc703e78b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:21.902427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db47fd-cb1d-4cf6-b7a7-af2dc703e78b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:21.902701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db47fd-cb1d-4cf6-b7a7-af2dc703e78b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:21.914520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db47fd-cb1d-4cf6-b7a7-af2dc703e78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:21.916058 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db47fd-cb1d-4cf6-b7a7-af2dc703e78b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:21.933949 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-37db47fd-cb1d-4cf6-b7a7-af2dc703e78b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:21.935598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 283/546] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:21.941833 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c260d7-ea25-4070-99db-158f37c1d4be None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:22.048810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c260d7-ea25-4070-99db-158f37c1d4be None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:22.051827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6befd-49a9-4ae2-a1c8-5c3e95d4e145 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:22.052123 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6befd-49a9-4ae2-a1c8-5c3e95d4e145 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:22.052407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6befd-49a9-4ae2-a1c8-5c3e95d4e145 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:22.054250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 284/547] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:06:22.059883 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18f7e2-23ef-453e-bb52-56eb73ecb63d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:22.060167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18f7e2-23ef-453e-bb52-56eb73ecb63d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:22.060449 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18f7e2-23ef-453e-bb52-56eb73ecb63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:22.088010 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ce569-b503-4423-9340-17a2fc7396e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:22.088677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ce569-b503-4423-9340-17a2fc7396e4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:22.088954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ce569-b503-4423-9340-17a2fc7396e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:22.089279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ce569-b503-4423-9340-17a2fc7396e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:22.090005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ce569-b503-4423-9340-17a2fc7396e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:22.090306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ce569-b503-4423-9340-17a2fc7396e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:22.090474 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-da18f7e2-23ef-453e-bb52-56eb73ecb63d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:22.091656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-da18f7e2-23ef-453e-bb52-56eb73ecb63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:22.091762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ce569-b503-4423-9340-17a2fc7396e4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:22.107387 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 264/548] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:22.113017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ce569-b503-4423-9340-17a2fc7396e4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:22.205368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 285/549] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:22.230433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18f7e2-23ef-453e-bb52-56eb73ecb63d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:22.236272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ce569-b503-4423-9340-17a2fc7396e4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:22.310385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3380aa-9c75-4bd8-b342-0fa65ea76985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:22.311106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3380aa-9c75-4bd8-b342-0fa65ea76985 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:22.311392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3380aa-9c75-4bd8-b342-0fa65ea76985 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:22.311669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3380aa-9c75-4bd8-b342-0fa65ea76985 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:22.330085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3380aa-9c75-4bd8-b342-0fa65ea76985 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:22.331694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3380aa-9c75-4bd8-b342-0fa65ea76985 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:22.355478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-ab3380aa-9c75-4bd8-b342-0fa65ea76985 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 14:06:22.362087 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 265/550] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Apr 12 14:06:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:22.369750 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3380aa-9c75-4bd8-b342-0fa65ea76985 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:22.390709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18f7e2-23ef-453e-bb52-56eb73ecb63d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:22.457380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e736b62-1a71-48e2-889c-0336b50d7226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:22.458515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e736b62-1a71-48e2-889c-0336b50d7226 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:22.458974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e736b62-1a71-48e2-889c-0336b50d7226 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:22.459430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e736b62-1a71-48e2-889c-0336b50d7226 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:22.470883 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e736b62-1a71-48e2-889c-0336b50d7226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:22.479052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-4e736b62-1a71-48e2-889c-0336b50d7226 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:22.480786 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 286/551] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:22.490788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e736b62-1a71-48e2-889c-0336b50d7226 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:22.596906 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3380aa-9c75-4bd8-b342-0fa65ea76985 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:22.603264 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e736b62-1a71-48e2-889c-0336b50d7226 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:22.640530 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b176b2-8a33-458c-8444-b4fcfff8d5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:22.641350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b176b2-8a33-458c-8444-b4fcfff8d5fb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:22.641635 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b176b2-8a33-458c-8444-b4fcfff8d5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:22.641910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b176b2-8a33-458c-8444-b4fcfff8d5fb None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:22.642646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b176b2-8a33-458c-8444-b4fcfff8d5fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:22.642952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b176b2-8a33-458c-8444-b4fcfff8d5fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:22.645031 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b176b2-8a33-458c-8444-b4fcfff8d5fb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:22.654057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 287/552] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:22.659388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b176b2-8a33-458c-8444-b4fcfff8d5fb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:22.670679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b98b4f-b313-4c6a-9fe8-dd0ba145dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:22.671371 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98b4f-b313-4c6a-9fe8-dd0ba145dc95 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:22.671647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98b4f-b313-4c6a-9fe8-dd0ba145dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:22.671914 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98b4f-b313-4c6a-9fe8-dd0ba145dc95 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:22.672755 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b98b4f-b313-4c6a-9fe8-dd0ba145dc95 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:22.673083 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b98b4f-b313-4c6a-9fe8-dd0ba145dc95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:22.674516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b98b4f-b313-4c6a-9fe8-dd0ba145dc95 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:22.694159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 266/553] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Apr 12 14:06:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:22.700282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b98b4f-b313-4c6a-9fe8-dd0ba145dc95 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:22.835209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b98b4f-b313-4c6a-9fe8-dd0ba145dc95 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:22.841250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b176b2-8a33-458c-8444-b4fcfff8d5fb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:22.874993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b50e8c-6f36-4f2f-bad4-494eff696c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:22.875653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b50e8c-6f36-4f2f-bad4-494eff696c8a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:22.876035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b50e8c-6f36-4f2f-bad4-494eff696c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:22.876319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b50e8c-6f36-4f2f-bad4-494eff696c8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:22.876572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa2e3-eb4f-49b2-820b-1c3b547219c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:22.877453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa2e3-eb4f-49b2-820b-1c3b547219c7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:22.877851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa2e3-eb4f-49b2-820b-1c3b547219c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:22.878960 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa2e3-eb4f-49b2-820b-1c3b547219c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:22.887725 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b50e8c-6f36-4f2f-bad4-494eff696c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:22.889201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b50e8c-6f36-4f2f-bad4-494eff696c8a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:22.890450 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daa2e3-eb4f-49b2-820b-1c3b547219c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:22.892381 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daa2e3-eb4f-49b2-820b-1c3b547219c7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:22.905779 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-03b50e8c-6f36-4f2f-bad4-494eff696c8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:22.907301 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 288/554] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:22.908631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29becaa-4ff6-4670-9569-a79b8c80b520 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:22.908922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29becaa-4ff6-4670-9569-a79b8c80b520 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:22.909253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29becaa-4ff6-4670-9569-a79b8c80b520 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:22.910916 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-52daa2e3-eb4f-49b2-820b-1c3b547219c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:22.912561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 267/556] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:22.913524 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa2e3-eb4f-49b2-820b-1c3b547219c7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:22.914796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 289/556] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:22.916012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fef8-95ca-483b-a489-2c99d1bd33f1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:22.916304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fef8-95ca-483b-a489-2c99d1bd33f1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:22.916580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fef8-95ca-483b-a489-2c99d1bd33f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:22.933676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-afd4fef8-95ca-483b-a489-2c99d1bd33f1 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:22.934924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-afd4fef8-95ca-483b-a489-2c99d1bd33f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:23.009265 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 290/557] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:23.010187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4fef8-95ca-483b-a489-2c99d1bd33f1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:23.016193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa2e3-eb4f-49b2-820b-1c3b547219c7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:23.050746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bd27f-fcc0-4ab9-b2aa-a145e6462825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:23.051408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bd27f-fcc0-4ab9-b2aa-a145e6462825 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:23.051689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bd27f-fcc0-4ab9-b2aa-a145e6462825 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:23.051963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bd27f-fcc0-4ab9-b2aa-a145e6462825 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:23.052682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bd27f-fcc0-4ab9-b2aa-a145e6462825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:23.053005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bd27f-fcc0-4ab9-b2aa-a145e6462825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:23.054383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bd27f-fcc0-4ab9-b2aa-a145e6462825 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:23.066900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 268/558] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:23.067793 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bd27f-fcc0-4ab9-b2aa-a145e6462825 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:23.132119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4fef8-95ca-483b-a489-2c99d1bd33f1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:23.166737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965beba-b1e3-4e41-841b-de5b72e63a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:23.167473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965beba-b1e3-4e41-841b-de5b72e63a11 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:23.167759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965beba-b1e3-4e41-841b-de5b72e63a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:23.167935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bd27f-fcc0-4ab9-b2aa-a145e6462825 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:23.168097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965beba-b1e3-4e41-841b-de5b72e63a11 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:23.168857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965beba-b1e3-4e41-841b-de5b72e63a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:23.169201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965beba-b1e3-4e41-841b-de5b72e63a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:23.170670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965beba-b1e3-4e41-841b-de5b72e63a11 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:23.182971 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 291/559] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:23.183909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965beba-b1e3-4e41-841b-de5b72e63a11 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:23.202858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecf157-564c-4949-a3e4-f7516beab010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:23.203652 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf157-564c-4949-a3e4-f7516beab010 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:23.204084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf157-564c-4949-a3e4-f7516beab010 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:23.204362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf157-564c-4949-a3e4-f7516beab010 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:23.218443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecf157-564c-4949-a3e4-f7516beab010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:23.227647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-e4ecf157-564c-4949-a3e4-f7516beab010 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:23.229523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 269/560] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:23.230365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecf157-564c-4949-a3e4-f7516beab010 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:23.293044 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965beba-b1e3-4e41-841b-de5b72e63a11 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:23.338214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d373e-bcab-46f6-a938-363f8f55cd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:23.339560 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d373e-bcab-46f6-a938-363f8f55cd62 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:23.339846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d373e-bcab-46f6-a938-363f8f55cd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:23.340393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d373e-bcab-46f6-a938-363f8f55cd62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:23.351396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d373e-bcab-46f6-a938-363f8f55cd62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:23.352849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d373e-bcab-46f6-a938-363f8f55cd62 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:23.357301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecf157-564c-4949-a3e4-f7516beab010 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:23.367295 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-ac5d373e-bcab-46f6-a938-363f8f55cd62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 14:06:23.368879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 292/561] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:23.369701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d373e-bcab-46f6-a938-363f8f55cd62 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:23.399390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebca78-496d-4754-967a-a8d171a2e8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:23.400658 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebca78-496d-4754-967a-a8d171a2e8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:23.400941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebca78-496d-4754-967a-a8d171a2e8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:23.401247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebca78-496d-4754-967a-a8d171a2e8f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:23.412447 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebca78-496d-4754-967a-a8d171a2e8f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:23.414301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebca78-496d-4754-967a-a8d171a2e8f6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:23.434079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-caebca78-496d-4754-967a-a8d171a2e8f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:23.436414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 270/562] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:23.437313 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebca78-496d-4754-967a-a8d171a2e8f6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:23.492857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d373e-bcab-46f6-a938-363f8f55cd62 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:23.540636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebca78-496d-4754-967a-a8d171a2e8f6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:23.541901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943c3b5-5485-4bb9-9f4f-fba6ce2efa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:23.542741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943c3b5-5485-4bb9-9f4f-fba6ce2efa9f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:23.543774 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943c3b5-5485-4bb9-9f4f-fba6ce2efa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:23.544074 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943c3b5-5485-4bb9-9f4f-fba6ce2efa9f None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:23.545137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943c3b5-5485-4bb9-9f4f-fba6ce2efa9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:23.545459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943c3b5-5485-4bb9-9f4f-fba6ce2efa9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:23.547013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943c3b5-5485-4bb9-9f4f-fba6ce2efa9f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:23.558317 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 293/563] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:23.559146 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943c3b5-5485-4bb9-9f4f-fba6ce2efa9f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:23.582488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df112729-b6f1-42e9-9b29-3976299014fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:23.583242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df112729-b6f1-42e9-9b29-3976299014fb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:23.583525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df112729-b6f1-42e9-9b29-3976299014fb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:23.583854 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df112729-b6f1-42e9-9b29-3976299014fb None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:23.584695 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df112729-b6f1-42e9-9b29-3976299014fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:23.585035 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df112729-b6f1-42e9-9b29-3976299014fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:23.586544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df112729-b6f1-42e9-9b29-3976299014fb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:23.604228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 271/564] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Apr 12 14:06:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:23.605101 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df112729-b6f1-42e9-9b29-3976299014fb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:23.695073 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943c3b5-5485-4bb9-9f4f-fba6ce2efa9f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:23.723849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df112729-b6f1-42e9-9b29-3976299014fb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:23.740272 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc41a4-9e52-432c-810e-a0fccfa4a1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:23.741139 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc41a4-9e52-432c-810e-a0fccfa4a1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:23.741430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc41a4-9e52-432c-810e-a0fccfa4a1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:23.742144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc41a4-9e52-432c-810e-a0fccfa4a1d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:23.742952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc41a4-9e52-432c-810e-a0fccfa4a1d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:23.743267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc41a4-9e52-432c-810e-a0fccfa4a1d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:23.745226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc41a4-9e52-432c-810e-a0fccfa4a1d4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:23.759641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f532021-fc21-4057-a1b8-7a292dc854e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:23.760433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532021-fc21-4057-a1b8-7a292dc854e9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:23.760804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532021-fc21-4057-a1b8-7a292dc854e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:23.761107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532021-fc21-4057-a1b8-7a292dc854e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:23.762287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 294/565] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:23.763132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc41a4-9e52-432c-810e-a0fccfa4a1d4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:23.777117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f532021-fc21-4057-a1b8-7a292dc854e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:23.778626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f532021-fc21-4057-a1b8-7a292dc854e9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:23.797368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-2f532021-fc21-4057-a1b8-7a292dc854e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:23.798871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 272/566] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:23.799687 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f532021-fc21-4057-a1b8-7a292dc854e9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:23.881563 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc41a4-9e52-432c-810e-a0fccfa4a1d4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:23.900830 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f532021-fc21-4057-a1b8-7a292dc854e9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:23.914836 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634595aa-704c-41ac-b304-890f9e7e3645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:23.915487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634595aa-704c-41ac-b304-890f9e7e3645 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:23.915766 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634595aa-704c-41ac-b304-890f9e7e3645 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:23.916097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634595aa-704c-41ac-b304-890f9e7e3645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:23.934252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a718798-44fb-458b-a6b2-ab79b075f4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:23.935126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a718798-44fb-458b-a6b2-ab79b075f4fd None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:23.935406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a718798-44fb-458b-a6b2-ab79b075f4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:23.935676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a718798-44fb-458b-a6b2-ab79b075f4fd None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/b9933c6dc8f74cd59f6a1f8c11abf652/roles/316db11de3994c7b86fcc1bba9da56bc` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:23.950551 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a718798-44fb-458b-a6b2-ab79b075f4fd None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=b9933c6dc8f74cd59f6a1f8c11abf652, role_id=316db11de3994c7b86fcc1bba9da56bc)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:23.951993 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a718798-44fb-458b-a6b2-ab79b075f4fd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:23.981743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634595aa-704c-41ac-b304-890f9e7e3645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:23.983194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634595aa-704c-41ac-b304-890f9e7e3645 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:24.023399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 273/567] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:06:23 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/b9933c6dc8f74cd59f6a1f8c11abf652/roles/316db11de3994c7b86fcc1bba9da56bc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:06:24.023399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a718798-44fb-458b-a6b2-ab79b075f4fd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:24.101789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 295/568] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:24.103480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b9b6-0f5d-4f02-917f-e5949ecf3baf None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.103780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b9b6-0f5d-4f02-917f-e5949ecf3baf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.104059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b9b6-0f5d-4f02-917f-e5949ecf3baf None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.110014 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 296/569] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:24.111065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6b9b6-0f5d-4f02-917f-e5949ecf3baf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:24.157317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a718798-44fb-458b-a6b2-ab79b075f4fd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:24.202500 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10718571-e706-4c35-95b3-6a90b10b6520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:24.203092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10718571-e706-4c35-95b3-6a90b10b6520 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.203374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10718571-e706-4c35-95b3-6a90b10b6520 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.203650 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10718571-e706-4c35-95b3-6a90b10b6520 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.204439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10718571-e706-4c35-95b3-6a90b10b6520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:24.204751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10718571-e706-4c35-95b3-6a90b10b6520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:24.206731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10718571-e706-4c35-95b3-6a90b10b6520 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:24.219501 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 274/570] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:24.220387 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bcf82-17ab-423d-a448-9f66850b45cb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.220677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bcf82-17ab-423d-a448-9f66850b45cb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.220954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bcf82-17ab-423d-a448-9f66850b45cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.234468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6b9b6-0f5d-4f02-917f-e5949ecf3baf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:24.241547 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6f5bcf82-17ab-423d-a448-9f66850b45cb None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:24.241759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6f5bcf82-17ab-423d-a448-9f66850b45cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:24.278126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00279e-b263-42e9-b964-c66e4eaa3221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:24.278978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00279e-b263-42e9-b964-c66e4eaa3221 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.279307 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00279e-b263-42e9-b964-c66e4eaa3221 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.279579 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00279e-b263-42e9-b964-c66e4eaa3221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.292832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00279e-b263-42e9-b964-c66e4eaa3221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:24.294799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00279e-b263-42e9-b964-c66e4eaa3221 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:24.317406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-2b00279e-b263-42e9-b964-c66e4eaa3221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:24.319276 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 275/572] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:24.325084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 297/572] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:24.325084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00279e-b263-42e9-b964-c66e4eaa3221 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:24.325760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bcf82-17ab-423d-a448-9f66850b45cb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:24.443604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bcf82-17ab-423d-a448-9f66850b45cb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:24.443926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00279e-b263-42e9-b964-c66e4eaa3221 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:24.479401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc2e82-3a77-4594-aac8-41c3ac53543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:24.479987 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc2e82-3a77-4594-aac8-41c3ac53543c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.480273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc2e82-3a77-4594-aac8-41c3ac53543c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.480552 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc2e82-3a77-4594-aac8-41c3ac53543c None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.481303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc2e82-3a77-4594-aac8-41c3ac53543c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:24.481623 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc2e82-3a77-4594-aac8-41c3ac53543c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:24.482125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c094531-dc29-4393-b3e3-3318098dbee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:24.482983 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc2e82-3a77-4594-aac8-41c3ac53543c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:24.483372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c094531-dc29-4393-b3e3-3318098dbee9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.483834 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c094531-dc29-4393-b3e3-3318098dbee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.484301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c094531-dc29-4393-b3e3-3318098dbee9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.492604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c094531-dc29-4393-b3e3-3318098dbee9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:24.494333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c094531-dc29-4393-b3e3-3318098dbee9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:24.499366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 298/573] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:24.500254 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc2e82-3a77-4594-aac8-41c3ac53543c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:24.510672 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-8c094531-dc29-4393-b3e3-3318098dbee9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 14:06:24.512488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 276/574] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:24.513470 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c094531-dc29-4393-b3e3-3318098dbee9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:24.600294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc2e82-3a77-4594-aac8-41c3ac53543c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:24.616056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c094531-dc29-4393-b3e3-3318098dbee9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:24.633627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645adca-3969-402f-9eef-c5435ef405d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:24.634425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645adca-3969-402f-9eef-c5435ef405d0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.634707 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645adca-3969-402f-9eef-c5435ef405d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.634977 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645adca-3969-402f-9eef-c5435ef405d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.645479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645adca-3969-402f-9eef-c5435ef405d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:24.649603 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29585ae2-7eee-4d60-8c14-4449fc2b0d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:24.650393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29585ae2-7eee-4d60-8c14-4449fc2b0d03 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.650676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29585ae2-7eee-4d60-8c14-4449fc2b0d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.650944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29585ae2-7eee-4d60-8c14-4449fc2b0d03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.652424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-7645adca-3969-402f-9eef-c5435ef405d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:24.658659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 299/575] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:24.658659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645adca-3969-402f-9eef-c5435ef405d0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:24.658861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29585ae2-7eee-4d60-8c14-4449fc2b0d03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:24.659457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29585ae2-7eee-4d60-8c14-4449fc2b0d03 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:24.672909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-29585ae2-7eee-4d60-8c14-4449fc2b0d03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:24.678838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 277/576] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:24.680210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed8876-7614-4cae-973d-70e82af6cd43 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.680503 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed8876-7614-4cae-973d-70e82af6cd43 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.680782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed8876-7614-4cae-973d-70e82af6cd43 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.682194 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 278/577] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:24.682830 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed8876-7614-4cae-973d-70e82af6cd43 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:24.769879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645adca-3969-402f-9eef-c5435ef405d0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:24.786209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed8876-7614-4cae-973d-70e82af6cd43 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:24.808510 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779b5ea-4460-49af-8a41-cb2d61ba8227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:24.810186 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779b5ea-4460-49af-8a41-cb2d61ba8227 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.810477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779b5ea-4460-49af-8a41-cb2d61ba8227 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.810748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779b5ea-4460-49af-8a41-cb2d61ba8227 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.811587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779b5ea-4460-49af-8a41-cb2d61ba8227 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:24.811899 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779b5ea-4460-49af-8a41-cb2d61ba8227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:24.814181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779b5ea-4460-49af-8a41-cb2d61ba8227 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:24.820886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944592a2-f664-4e7e-889f-f5cb3181e275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:24.821827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944592a2-f664-4e7e-889f-f5cb3181e275 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.822127 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944592a2-f664-4e7e-889f-f5cb3181e275 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.822375 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944592a2-f664-4e7e-889f-f5cb3181e275 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.823107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944592a2-f664-4e7e-889f-f5cb3181e275 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:24.823407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944592a2-f664-4e7e-889f-f5cb3181e275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:24.824762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944592a2-f664-4e7e-889f-f5cb3181e275 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:24.839308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 279/578] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:24.839308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944592a2-f664-4e7e-889f-f5cb3181e275 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:24.839872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 300/579] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Apr 12 14:06:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:24.842017 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a1d7-9a42-42be-b7db-41625cd37b9b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.842305 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a1d7-9a42-42be-b7db-41625cd37b9b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.842579 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a1d7-9a42-42be-b7db-41625cd37b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.860070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fe72a1d7-9a42-42be-b7db-41625cd37b9b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:24.861368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fe72a1d7-9a42-42be-b7db-41625cd37b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:24.937004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 301/580] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:24.937004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72a1d7-9a42-42be-b7db-41625cd37b9b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:24.955061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944592a2-f664-4e7e-889f-f5cb3181e275 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:24.990610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a29cb3-3e77-46e8-90c0-c51c52a87b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:24.991268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a29cb3-3e77-46e8-90c0-c51c52a87b3b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:24.991550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a29cb3-3e77-46e8-90c0-c51c52a87b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:24.991823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a29cb3-3e77-46e8-90c0-c51c52a87b3b None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:24.992600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a29cb3-3e77-46e8-90c0-c51c52a87b3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:24.992919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a29cb3-3e77-46e8-90c0-c51c52a87b3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:24.994366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a29cb3-3e77-46e8-90c0-c51c52a87b3b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:25.012144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 280/581] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:25.012144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a29cb3-3e77-46e8-90c0-c51c52a87b3b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:25.039172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72a1d7-9a42-42be-b7db-41625cd37b9b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:25.073158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac2832-d62f-4dbd-a5f7-195207609ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:25.073955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac2832-d62f-4dbd-a5f7-195207609ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:25.074235 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac2832-d62f-4dbd-a5f7-195207609ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:25.074508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac2832-d62f-4dbd-a5f7-195207609ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:25.085492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac2832-d62f-4dbd-a5f7-195207609ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:25.086948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac2832-d62f-4dbd-a5f7-195207609ce1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:25.105324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-8aac2832-d62f-4dbd-a5f7-195207609ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:25.111192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 302/582] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:25.111192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac2832-d62f-4dbd-a5f7-195207609ce1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:25.115279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a29cb3-3e77-46e8-90c0-c51c52a87b3b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:25.152105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fde279-11dd-4e49-b2bb-dd387fa4e659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:25.153287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde279-11dd-4e49-b2bb-dd387fa4e659 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:25.153802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde279-11dd-4e49-b2bb-dd387fa4e659 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:25.154273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde279-11dd-4e49-b2bb-dd387fa4e659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:25.165405 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fde279-11dd-4e49-b2bb-dd387fa4e659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:25.167030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fde279-11dd-4e49-b2bb-dd387fa4e659 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:25.184400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-97fde279-11dd-4e49-b2bb-dd387fa4e659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:25.191072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 281/583] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:25.191072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fde279-11dd-4e49-b2bb-dd387fa4e659 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:25.211761 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac2832-d62f-4dbd-a5f7-195207609ce1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:25.246802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d636a8e-d35b-41fc-a8a6-71a707cb4bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:25.247602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636a8e-d35b-41fc-a8a6-71a707cb4bae None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:25.247886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636a8e-d35b-41fc-a8a6-71a707cb4bae None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:25.248149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636a8e-d35b-41fc-a8a6-71a707cb4bae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:25.258142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d636a8e-d35b-41fc-a8a6-71a707cb4bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:25.265153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-0d636a8e-d35b-41fc-a8a6-71a707cb4bae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:25.271282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 303/584] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:25.271282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d636a8e-d35b-41fc-a8a6-71a707cb4bae None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:25.294397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fde279-11dd-4e49-b2bb-dd387fa4e659 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:25.328137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a67b9-bdc8-41cf-af19-e94379e66288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:25.328782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a67b9-bdc8-41cf-af19-e94379e66288 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:25.329159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a67b9-bdc8-41cf-af19-e94379e66288 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:25.329440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a67b9-bdc8-41cf-af19-e94379e66288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:25.330258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a67b9-bdc8-41cf-af19-e94379e66288 None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=987dcad83b914b5894955dfe3e1f71ab) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:25.330577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a67b9-bdc8-41cf-af19-e94379e66288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:25.332468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a67b9-bdc8-41cf-af19-e94379e66288 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:25.337742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 282/585] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/role_assignments?user.id=987dcad83b914b5894955dfe3e1f71ab&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:25.338504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a67b9-bdc8-41cf-af19-e94379e66288 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:25.388564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d636a8e-d35b-41fc-a8a6-71a707cb4bae None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:25.434438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7ee62-5b8b-466a-8917-f5ef00509906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:25.435137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ee62-5b8b-466a-8917-f5ef00509906 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:25.435448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ee62-5b8b-466a-8917-f5ef00509906 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:25.435736 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ee62-5b8b-466a-8917-f5ef00509906 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:25.436531 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7ee62-5b8b-466a-8917-f5ef00509906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:25.437067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7ee62-5b8b-466a-8917-f5ef00509906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:25.438287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7ee62-5b8b-466a-8917-f5ef00509906 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:25.457455 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 304/586] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:25.458598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7ee62-5b8b-466a-8917-f5ef00509906 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:25.471227 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a67b9-bdc8-41cf-af19-e94379e66288 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:25.509151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c2a44-10da-434d-97e5-c4f89d812166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:25.510204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2a44-10da-434d-97e5-c4f89d812166 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:25.510690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2a44-10da-434d-97e5-c4f89d812166 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:25.511198 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2a44-10da-434d-97e5-c4f89d812166 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:25.512137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c2a44-10da-434d-97e5-c4f89d812166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:25.512653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c2a44-10da-434d-97e5-c4f89d812166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:25.514316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c2a44-10da-434d-97e5-c4f89d812166 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:25.528556 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 283/587] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:25.529762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c2a44-10da-434d-97e5-c4f89d812166 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:25.567269 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7ee62-5b8b-466a-8917-f5ef00509906 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:25.601377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8415-e7f6-49cb-b042-5a87c2e63bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:25.602079 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8415-e7f6-49cb-b042-5a87c2e63bba None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:25.602363 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8415-e7f6-49cb-b042-5a87c2e63bba None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:25.602640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8415-e7f6-49cb-b042-5a87c2e63bba None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:25.603388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a8415-e7f6-49cb-b042-5a87c2e63bba None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:25.603751 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a8415-e7f6-49cb-b042-5a87c2e63bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:25.605214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a8415-e7f6-49cb-b042-5a87c2e63bba None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:25.614495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 305/588] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:25.615321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8415-e7f6-49cb-b042-5a87c2e63bba None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:25.638631 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c2a44-10da-434d-97e5-c4f89d812166 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:25.685453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72bf7-f866-4a2a-ada8-1156706bca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:25.686486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72bf7-f866-4a2a-ada8-1156706bca0d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:25.686944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72bf7-f866-4a2a-ada8-1156706bca0d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:25.687367 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72bf7-f866-4a2a-ada8-1156706bca0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:25.694920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b72bf7-f866-4a2a-ada8-1156706bca0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:25.696895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b72bf7-f866-4a2a-ada8-1156706bca0d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:25.710965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-c2b72bf7-f866-4a2a-ada8-1156706bca0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:25.717000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 284/589] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:25.717977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72bf7-f866-4a2a-ada8-1156706bca0d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:25.719386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8415-e7f6-49cb-b042-5a87c2e63bba None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:25.755405 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc073eea-3efb-44fa-835f-6812ac66e510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:25.756250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc073eea-3efb-44fa-835f-6812ac66e510 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:25.756594 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc073eea-3efb-44fa-835f-6812ac66e510 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:25.756901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc073eea-3efb-44fa-835f-6812ac66e510 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:25.764852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc073eea-3efb-44fa-835f-6812ac66e510 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:25.766385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc073eea-3efb-44fa-835f-6812ac66e510 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:25.780627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-fc073eea-3efb-44fa-835f-6812ac66e510 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 14:06:25.786742 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 306/590] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:25.786742 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc073eea-3efb-44fa-835f-6812ac66e510 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:25.829015 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72bf7-f866-4a2a-ada8-1156706bca0d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:25.863431 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe8dd-18a0-473b-ae4b-fd8a756e7e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:25.864467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe8dd-18a0-473b-ae4b-fd8a756e7e35 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:25.864921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe8dd-18a0-473b-ae4b-fd8a756e7e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:25.865419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe8dd-18a0-473b-ae4b-fd8a756e7e35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:25.876308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffe8dd-18a0-473b-ae4b-fd8a756e7e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:25.878208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffe8dd-18a0-473b-ae4b-fd8a756e7e35 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:25.883501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc073eea-3efb-44fa-835f-6812ac66e510 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:25.897367 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-d6ffe8dd-18a0-473b-ae4b-fd8a756e7e35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:25.898762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 285/591] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:25.899699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe8dd-18a0-473b-ae4b-fd8a756e7e35 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:25.922588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f3a2f-ca2d-4ffe-a55e-0dd3f68a2144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:25.923253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3a2f-ca2d-4ffe-a55e-0dd3f68a2144 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:25.923536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3a2f-ca2d-4ffe-a55e-0dd3f68a2144 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:25.923810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3a2f-ca2d-4ffe-a55e-0dd3f68a2144 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:25.925255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f3a2f-ca2d-4ffe-a55e-0dd3f68a2144 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:25.925461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f3a2f-ca2d-4ffe-a55e-0dd3f68a2144 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:25.926886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f3a2f-ca2d-4ffe-a55e-0dd3f68a2144 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:25.939050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 307/592] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:25.944414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f3a2f-ca2d-4ffe-a55e-0dd3f68a2144 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:26.013409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe8dd-18a0-473b-ae4b-fd8a756e7e35 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:26.043063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f3a2f-ca2d-4ffe-a55e-0dd3f68a2144 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:26.050907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90865ae3-f4fb-463a-af38-b15960c05ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:26.051806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90865ae3-f4fb-463a-af38-b15960c05ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.052233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90865ae3-f4fb-463a-af38-b15960c05ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.052648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90865ae3-f4fb-463a-af38-b15960c05ef6 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:26.053651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90865ae3-f4fb-463a-af38-b15960c05ef6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:26.054102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90865ae3-f4fb-463a-af38-b15960c05ef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:26.055694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90865ae3-f4fb-463a-af38-b15960c05ef6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:26.079228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016edf9b-5261-4c3e-ba3a-322421754993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:26.079228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016edf9b-5261-4c3e-ba3a-322421754993 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.079504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016edf9b-5261-4c3e-ba3a-322421754993 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.079647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 286/593] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:26.079744 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016edf9b-5261-4c3e-ba3a-322421754993 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:26.080420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016edf9b-5261-4c3e-ba3a-322421754993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:26.080777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016edf9b-5261-4c3e-ba3a-322421754993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:26.081651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90865ae3-f4fb-463a-af38-b15960c05ef6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:26.083007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016edf9b-5261-4c3e-ba3a-322421754993 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:26.099587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 308/594] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:26.100476 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016edf9b-5261-4c3e-ba3a-322421754993 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:26.184213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90865ae3-f4fb-463a-af38-b15960c05ef6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:26.201179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016edf9b-5261-4c3e-ba3a-322421754993 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:26.220121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb09c3-eac0-48a5-ba3e-115a1bf9a6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:26.221996 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb09c3-eac0-48a5-ba3e-115a1bf9a6ed None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.222425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb09c3-eac0-48a5-ba3e-115a1bf9a6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.222837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb09c3-eac0-48a5-ba3e-115a1bf9a6ed None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/21ef8bbd229c488d97f167c810bc7cfd/roles/316db11de3994c7b86fcc1bba9da56bc` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:26.235791 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e55cd-e492-49cf-9425-c27065ecb0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:26.236590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e55cd-e492-49cf-9425-c27065ecb0cb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.236874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e55cd-e492-49cf-9425-c27065ecb0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.237818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e55cd-e492-49cf-9425-c27065ecb0cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:26.239708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb09c3-eac0-48a5-ba3e-115a1bf9a6ed None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=21ef8bbd229c488d97f167c810bc7cfd, role_id=316db11de3994c7b86fcc1bba9da56bc)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:26.241378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb09c3-eac0-48a5-ba3e-115a1bf9a6ed None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:26.248636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e55cd-e492-49cf-9425-c27065ecb0cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:26.250105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e55cd-e492-49cf-9425-c27065ecb0cb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:26.266340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-fd6e55cd-e492-49cf-9425-c27065ecb0cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:26.272167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 309/595] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:26.272167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e55cd-e492-49cf-9425-c27065ecb0cb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:26.349853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 287/596] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:06:26 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/21ef8bbd229c488d97f167c810bc7cfd/roles/316db11de3994c7b86fcc1bba9da56bc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:06:26.351265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb09c3-eac0-48a5-ba3e-115a1bf9a6ed None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:26.394438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e55cd-e492-49cf-9425-c27065ecb0cb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:26.432653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b040-678d-478f-bc87-b72a036c1d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:26.433677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b040-678d-478f-bc87-b72a036c1d7e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.434294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b040-678d-478f-bc87-b72a036c1d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.434587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b040-678d-478f-bc87-b72a036c1d7e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:26.447218 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b040-678d-478f-bc87-b72a036c1d7e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:26.449499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b040-678d-478f-bc87-b72a036c1d7e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:26.472706 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-4c23b040-678d-478f-bc87-b72a036c1d7e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 14:06:26.479176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 310/597] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:26.481109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b4229-7237-4d2d-ad07-4c1c2a1a1fa4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.481304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb09c3-eac0-48a5-ba3e-115a1bf9a6ed None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:26.481783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b4229-7237-4d2d-ad07-4c1c2a1a1fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.482264 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b4229-7237-4d2d-ad07-4c1c2a1a1fa4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:26.484586 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 311/598] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:26.485944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b4229-7237-4d2d-ad07-4c1c2a1a1fa4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:26.524036 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b80295-6352-449d-bc6d-7efaac621982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:26.524708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b80295-6352-449d-bc6d-7efaac621982 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.525004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b80295-6352-449d-bc6d-7efaac621982 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.525274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b80295-6352-449d-bc6d-7efaac621982 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:26.526007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b80295-6352-449d-bc6d-7efaac621982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:26.526312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b80295-6352-449d-bc6d-7efaac621982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:26.527731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b80295-6352-449d-bc6d-7efaac621982 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:26.540892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 288/599] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:26.542222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4a813-1083-4f02-bac0-800afb4c5cb9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.542509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4a813-1083-4f02-bac0-800afb4c5cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.542781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4a813-1083-4f02-bac0-800afb4c5cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:26.561738 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e2e4a813-1083-4f02-bac0-800afb4c5cb9 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:26.562919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e2e4a813-1083-4f02-bac0-800afb4c5cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:26.604458 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b4229-7237-4d2d-ad07-4c1c2a1a1fa4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:26.637551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b02b6a-a705-4325-934e-1c0c1852f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:26.638223 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02b6a-a705-4325-934e-1c0c1852f896 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.638505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02b6a-a705-4325-934e-1c0c1852f896 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.638832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02b6a-a705-4325-934e-1c0c1852f896 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:26.639664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b02b6a-a705-4325-934e-1c0c1852f896 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:26.639972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b02b6a-a705-4325-934e-1c0c1852f896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:26.640196 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 289/600] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:26.641462 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b02b6a-a705-4325-934e-1c0c1852f896 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:26.645068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4a813-1083-4f02-bac0-800afb4c5cb9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:26.683210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 312/601] 10.222.0.61 () {56 vars in 1139 bytes} [Tue Apr 12 14:06:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:26.684176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b02b6a-a705-4325-934e-1c0c1852f896 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:26.782192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4a813-1083-4f02-bac0-800afb4c5cb9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:26.787872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b02b6a-a705-4325-934e-1c0c1852f896 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:26.818986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c6f0b-ee3d-4692-8825-344a44b8aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:26.820153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6f0b-ee3d-4692-8825-344a44b8aa7e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.820633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6f0b-ee3d-4692-8825-344a44b8aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.821128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6f0b-ee3d-4692-8825-344a44b8aa7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:26.823162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f6428-c3b1-4591-8094-24daa01db6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:26.823951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f6428-c3b1-4591-8094-24daa01db6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.824229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f6428-c3b1-4591-8094-24daa01db6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.824501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f6428-c3b1-4591-8094-24daa01db6d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:26.829306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c6f0b-ee3d-4692-8825-344a44b8aa7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:26.831061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c6f0b-ee3d-4692-8825-344a44b8aa7e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:26.835392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f6428-c3b1-4591-8094-24daa01db6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:26.842464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-735f6428-c3b1-4591-8094-24daa01db6d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:26.843962 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 313/602] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:26.844801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f6428-c3b1-4591-8094-24daa01db6d0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:26.845472 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-4a5c6f0b-ee3d-4692-8825-344a44b8aa7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:26.847965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 290/603] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:26.849809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c6f0b-ee3d-4692-8825-344a44b8aa7e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:26.958336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f6428-c3b1-4591-8094-24daa01db6d0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:26.972513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c6f0b-ee3d-4692-8825-344a44b8aa7e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:26.993749 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01963a12-68bb-44c1-b1c7-39f76ddc573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:26.995017 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963a12-68bb-44c1-b1c7-39f76ddc573f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:26.995459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963a12-68bb-44c1-b1c7-39f76ddc573f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:26.995882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963a12-68bb-44c1-b1c7-39f76ddc573f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.007669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01963a12-68bb-44c1-b1c7-39f76ddc573f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:27.009342 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01963a12-68bb-44c1-b1c7-39f76ddc573f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:27.012607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5edd-590a-4fda-aa20-7ae88480c4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:27.013977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5edd-590a-4fda-aa20-7ae88480c4bd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:27.014510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5edd-590a-4fda-aa20-7ae88480c4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:27.014675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5edd-590a-4fda-aa20-7ae88480c4bd None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.015508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5edd-590a-4fda-aa20-7ae88480c4bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:27.015909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5edd-590a-4fda-aa20-7ae88480c4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:27.017796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5edd-590a-4fda-aa20-7ae88480c4bd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:27.027676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 291/604] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:27.028376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-01963a12-68bb-44c1-b1c7-39f76ddc573f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:27.028787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5edd-590a-4fda-aa20-7ae88480c4bd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:27.035273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 314/605] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:27.036371 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01963a12-68bb-44c1-b1c7-39f76ddc573f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:27.149645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5edd-590a-4fda-aa20-7ae88480c4bd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:27.155832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01963a12-68bb-44c1-b1c7-39f76ddc573f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:27.188875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab8e36-3dc4-44bc-af6c-96ac7e6d7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:27.189898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab8e36-3dc4-44bc-af6c-96ac7e6d7ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:27.190370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab8e36-3dc4-44bc-af6c-96ac7e6d7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:27.191006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab8e36-3dc4-44bc-af6c-96ac7e6d7ea8 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.191944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab8e36-3dc4-44bc-af6c-96ac7e6d7ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:27.192398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab8e36-3dc4-44bc-af6c-96ac7e6d7ea8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:27.194072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab8e36-3dc4-44bc-af6c-96ac7e6d7ea8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:27.198906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cd207-dbf2-40a3-9b61-2c28843cb6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:27.199775 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cd207-dbf2-40a3-9b61-2c28843cb6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:27.200126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cd207-dbf2-40a3-9b61-2c28843cb6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:27.200467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cd207-dbf2-40a3-9b61-2c28843cb6c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.209136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 292/606] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:27.210441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab8e36-3dc4-44bc-af6c-96ac7e6d7ea8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:27.218982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cd207-dbf2-40a3-9b61-2c28843cb6c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:27.220847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cd207-dbf2-40a3-9b61-2c28843cb6c8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:27.244015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-085cd207-dbf2-40a3-9b61-2c28843cb6c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:27.245444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 315/607] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:27.246280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cd207-dbf2-40a3-9b61-2c28843cb6c8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:27.321659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab8e36-3dc4-44bc-af6c-96ac7e6d7ea8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:27.368516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cd207-dbf2-40a3-9b61-2c28843cb6c8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:27.369348 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef846acd-aff2-4013-98c7-1a1972c69816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:27.370396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef846acd-aff2-4013-98c7-1a1972c69816 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:27.371630 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef846acd-aff2-4013-98c7-1a1972c69816 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:27.372104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef846acd-aff2-4013-98c7-1a1972c69816 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.373092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef846acd-aff2-4013-98c7-1a1972c69816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:27.373601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef846acd-aff2-4013-98c7-1a1972c69816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:27.375280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef846acd-aff2-4013-98c7-1a1972c69816 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:27.395062 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 293/608] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:27.395062 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef846acd-aff2-4013-98c7-1a1972c69816 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:27.412914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c13b8-28d0-4d8e-85e6-1041d907d0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:27.414387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c13b8-28d0-4d8e-85e6-1041d907d0ea None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:27.414873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c13b8-28d0-4d8e-85e6-1041d907d0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:27.415322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c13b8-28d0-4d8e-85e6-1041d907d0ea None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/c6ca11a750dc4234b4512e6274ca01a5/roles/316db11de3994c7b86fcc1bba9da56bc` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.434612 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c13b8-28d0-4d8e-85e6-1041d907d0ea None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=c6ca11a750dc4234b4512e6274ca01a5, role_id=316db11de3994c7b86fcc1bba9da56bc)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:27.436732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c13b8-28d0-4d8e-85e6-1041d907d0ea None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:27.495646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef846acd-aff2-4013-98c7-1a1972c69816 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:27.519709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 316/609] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:06:27 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/c6ca11a750dc4234b4512e6274ca01a5/roles/316db11de3994c7b86fcc1bba9da56bc => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:06:27.521309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c13b8-28d0-4d8e-85e6-1041d907d0ea None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:27.541197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ea4af-2e1b-44a3-99aa-36d99960b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:27.541870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ea4af-2e1b-44a3-99aa-36d99960b207 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:27.542155 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ea4af-2e1b-44a3-99aa-36d99960b207 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:27.542430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ea4af-2e1b-44a3-99aa-36d99960b207 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.543168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ea4af-2e1b-44a3-99aa-36d99960b207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:27.543539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ea4af-2e1b-44a3-99aa-36d99960b207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:27.544991 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ea4af-2e1b-44a3-99aa-36d99960b207 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:27.567735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 294/610] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:27.573322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ea4af-2e1b-44a3-99aa-36d99960b207 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:27.649319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c13b8-28d0-4d8e-85e6-1041d907d0ea None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:27.710410 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ea4af-2e1b-44a3-99aa-36d99960b207 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:27.722924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f6473-add1-42e6-96cc-e00cc3632da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:27.723905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f6473-add1-42e6-96cc-e00cc3632da0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:27.724015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f6473-add1-42e6-96cc-e00cc3632da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:27.724285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f6473-add1-42e6-96cc-e00cc3632da0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.731701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f6473-add1-42e6-96cc-e00cc3632da0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:27.733233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f6473-add1-42e6-96cc-e00cc3632da0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:27.747727 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-d18f6473-add1-42e6-96cc-e00cc3632da0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:27.749296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 317/611] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:27.750520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797ba4-2f31-4ec7-ac8a-23a6f50ef51a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:27.750809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797ba4-2f31-4ec7-ac8a-23a6f50ef51a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:27.751094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797ba4-2f31-4ec7-ac8a-23a6f50ef51a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.751443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf1e5-0bf3-4203-bc8f-d477e8678ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:27.753057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf1e5-0bf3-4203-bc8f-d477e8678ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:27.753902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf1e5-0bf3-4203-bc8f-d477e8678ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:27.754388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf1e5-0bf3-4203-bc8f-d477e8678ed9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.757042 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 318/612] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:27.758068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c797ba4-2f31-4ec7-ac8a-23a6f50ef51a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:27.766562 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf1e5-0bf3-4203-bc8f-d477e8678ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:27.768684 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf1e5-0bf3-4203-bc8f-d477e8678ed9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:27.783591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-7cdbf1e5-0bf3-4203-bc8f-d477e8678ed9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 14:06:27.785776 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 295/613] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Apr 12 14:06:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:27.787258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b1460-707a-45ca-9190-fb6e07a5e2a7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:27.787762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b1460-707a-45ca-9190-fb6e07a5e2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:27.788242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b1460-707a-45ca-9190-fb6e07a5e2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.810954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-415b1460-707a-45ca-9190-fb6e07a5e2a7 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:27.813312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-415b1460-707a-45ca-9190-fb6e07a5e2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:27.886327 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c797ba4-2f31-4ec7-ac8a-23a6f50ef51a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:27.903956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 296/614] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:27.905059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b1460-707a-45ca-9190-fb6e07a5e2a7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:27.944039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b709-dbde-4435-9e03-73d37f947a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:27.944876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b709-dbde-4435-9e03-73d37f947a44 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:27.945247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b709-dbde-4435-9e03-73d37f947a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:27.945846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b709-dbde-4435-9e03-73d37f947a44 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:27.947168 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087b709-dbde-4435-9e03-73d37f947a44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:27.947487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087b709-dbde-4435-9e03-73d37f947a44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:27.949785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087b709-dbde-4435-9e03-73d37f947a44 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:27.965596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 319/615] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:27.966439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b709-dbde-4435-9e03-73d37f947a44 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:28.030582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b1460-707a-45ca-9190-fb6e07a5e2a7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:28.066557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe28bf-fa57-4181-abb1-02acd4e0fd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:28.067222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe28bf-fa57-4181-abb1-02acd4e0fd2a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:28.067501 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe28bf-fa57-4181-abb1-02acd4e0fd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:28.067813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe28bf-fa57-4181-abb1-02acd4e0fd2a None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:28.068646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe28bf-fa57-4181-abb1-02acd4e0fd2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:28.068950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe28bf-fa57-4181-abb1-02acd4e0fd2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:28.070390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe28bf-fa57-4181-abb1-02acd4e0fd2a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:28.085631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b709-dbde-4435-9e03-73d37f947a44 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:28.088253 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 297/616] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Apr 12 14:06:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:28.088864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe28bf-fa57-4181-abb1-02acd4e0fd2a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:28.128023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa7776-cc29-46fd-8011-447bfc2dbd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:28.128835 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa7776-cc29-46fd-8011-447bfc2dbd9a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:28.129152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa7776-cc29-46fd-8011-447bfc2dbd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:28.129799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa7776-cc29-46fd-8011-447bfc2dbd9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:28.146437 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa7776-cc29-46fd-8011-447bfc2dbd9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:28.153408 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-9baa7776-cc29-46fd-8011-447bfc2dbd9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:28.154972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 320/617] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:28.155799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa7776-cc29-46fd-8011-447bfc2dbd9a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:28.202463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe28bf-fa57-4181-abb1-02acd4e0fd2a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:28.238344 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63990310-ff92-451c-a898-3d72f647ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:28.239408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63990310-ff92-451c-a898-3d72f647ff28 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:28.239755 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63990310-ff92-451c-a898-3d72f647ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:28.240097 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63990310-ff92-451c-a898-3d72f647ff28 None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/fa7ee0856f4644c994c3ccbd400b6fbb/roles/316db11de3994c7b86fcc1bba9da56bc` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:28.255096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63990310-ff92-451c-a898-3d72f647ff28 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=fa7ee0856f4644c994c3ccbd400b6fbb, role_id=316db11de3994c7b86fcc1bba9da56bc)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:28.256651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63990310-ff92-451c-a898-3d72f647ff28 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:28.277322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa7776-cc29-46fd-8011-447bfc2dbd9a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:28.335636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64995d6-75a0-4ed9-94b6-221023037b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:28.336211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64995d6-75a0-4ed9-94b6-221023037b09 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:28.336495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64995d6-75a0-4ed9-94b6-221023037b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:28.336776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64995d6-75a0-4ed9-94b6-221023037b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:28.343525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 298/618] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:06:28 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/fa7ee0856f4644c994c3ccbd400b6fbb/roles/316db11de3994c7b86fcc1bba9da56bc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:06:28.344626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63990310-ff92-451c-a898-3d72f647ff28 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:28.472002 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63990310-ff92-451c-a898-3d72f647ff28 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:28.482243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64995d6-75a0-4ed9-94b6-221023037b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:28.483738 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64995d6-75a0-4ed9-94b6-221023037b09 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:28.513841 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb447b0-f7e7-4b19-9210-6cf572c3eee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:28.515437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb447b0-f7e7-4b19-9210-6cf572c3eee8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:28.516177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb447b0-f7e7-4b19-9210-6cf572c3eee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:28.516659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb447b0-f7e7-4b19-9210-6cf572c3eee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:28.517661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb447b0-f7e7-4b19-9210-6cf572c3eee8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:28.518950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb447b0-f7e7-4b19-9210-6cf572c3eee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:28.520670 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb447b0-f7e7-4b19-9210-6cf572c3eee8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:28.531549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 299/619] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:28.538443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb447b0-f7e7-4b19-9210-6cf572c3eee8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:28.650049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 321/620] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:28.657013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64995d6-75a0-4ed9-94b6-221023037b09 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:28.680434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb447b0-f7e7-4b19-9210-6cf572c3eee8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:28.750166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268d08-92cc-4622-92fa-d5c64caf6bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:28.751022 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268d08-92cc-4622-92fa-d5c64caf6bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:28.751300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268d08-92cc-4622-92fa-d5c64caf6bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:28.751622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268d08-92cc-4622-92fa-d5c64caf6bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:28.770999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6268d08-92cc-4622-92fa-d5c64caf6bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:28.772484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6268d08-92cc-4622-92fa-d5c64caf6bb6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:28.809080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-d6268d08-92cc-4622-92fa-d5c64caf6bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:28.813487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 300/621] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:28.820584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268d08-92cc-4622-92fa-d5c64caf6bb6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:28.845030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64995d6-75a0-4ed9-94b6-221023037b09 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:28.891980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359fce-e7a2-4f8c-b1cc-c64392f70f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:28.893225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359fce-e7a2-4f8c-b1cc-c64392f70f5e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:28.893624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359fce-e7a2-4f8c-b1cc-c64392f70f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:28.893906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359fce-e7a2-4f8c-b1cc-c64392f70f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:28.906785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc359fce-e7a2-4f8c-b1cc-c64392f70f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:28.908154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc359fce-e7a2-4f8c-b1cc-c64392f70f5e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:28.930165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-cc359fce-e7a2-4f8c-b1cc-c64392f70f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:28.931959 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 322/622] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:28.933830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f10a56-9f63-4ba0-8f3c-f562428c66e3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:28.934242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f10a56-9f63-4ba0-8f3c-f562428c66e3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:28.934532 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f10a56-9f63-4ba0-8f3c-f562428c66e3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:28.936053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 323/623] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:28.936566 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268d08-92cc-4622-92fa-d5c64caf6bb6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:28.936938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f10a56-9f63-4ba0-8f3c-f562428c66e3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:28.974033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9033da-a9a0-4dd0-8886-6f6334b933e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:28.975048 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9033da-a9a0-4dd0-8886-6f6334b933e7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:28.975542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9033da-a9a0-4dd0-8886-6f6334b933e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:28.976006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9033da-a9a0-4dd0-8886-6f6334b933e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:28.977183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9033da-a9a0-4dd0-8886-6f6334b933e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:28.977727 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9033da-a9a0-4dd0-8886-6f6334b933e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:28.979369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9033da-a9a0-4dd0-8886-6f6334b933e7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:28.992707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 301/624] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:28.994316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe8f3-995c-475e-8444-364261273203 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:28.994974 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe8f3-995c-475e-8444-364261273203 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:28.995662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe8f3-995c-475e-8444-364261273203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.014037 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cf4fe8f3-995c-475e-8444-364261273203 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:29.015875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cf4fe8f3-995c-475e-8444-364261273203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:29.050387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f10a56-9f63-4ba0-8f3c-f562428c66e3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:29.084290 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a24a4-4dd9-4592-bb39-42080e051af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:29.084821 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 302/625] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:29.085283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a24a4-4dd9-4592-bb39-42080e051af7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:29.085357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a24a4-4dd9-4592-bb39-42080e051af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:29.085711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a24a4-4dd9-4592-bb39-42080e051af7 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.086506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a24a4-4dd9-4592-bb39-42080e051af7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:29.086711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fe8f3-995c-475e-8444-364261273203 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:29.086951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a24a4-4dd9-4592-bb39-42080e051af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:29.088381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a24a4-4dd9-4592-bb39-42080e051af7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:29.101027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 324/626] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:29.106219 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a24a4-4dd9-4592-bb39-42080e051af7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:29.199337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fe8f3-995c-475e-8444-364261273203 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:29.210515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a24a4-4dd9-4592-bb39-42080e051af7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:29.245599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25246416-69a7-48f4-849b-dc11603ec225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:29.246395 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25246416-69a7-48f4-849b-dc11603ec225 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:29.246675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25246416-69a7-48f4-849b-dc11603ec225 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:29.246949 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25246416-69a7-48f4-849b-dc11603ec225 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.252558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d0c7-f668-466e-b801-0c211bfaa9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:29.253715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d0c7-f668-466e-b801-0c211bfaa9fd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:29.254198 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d0c7-f668-466e-b801-0c211bfaa9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:29.254681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d0c7-f668-466e-b801-0c211bfaa9fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.257949 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25246416-69a7-48f4-849b-dc11603ec225 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:29.259423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25246416-69a7-48f4-849b-dc11603ec225 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:29.263163 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4d0c7-f668-466e-b801-0c211bfaa9fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:29.265116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4d0c7-f668-466e-b801-0c211bfaa9fd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:29.275656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-25246416-69a7-48f4-849b-dc11603ec225 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 14:06:29.276827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 303/627] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:29.277912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25246416-69a7-48f4-849b-dc11603ec225 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:29.284387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-95c4d0c7-f668-466e-b801-0c211bfaa9fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:29.284387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 325/628] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:29.289613 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d0c7-f668-466e-b801-0c211bfaa9fd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:29.384778 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25246416-69a7-48f4-849b-dc11603ec225 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:29.389935 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d0c7-f668-466e-b801-0c211bfaa9fd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:29.421240 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054da32-abde-44a7-8ffa-bc6df9fe0d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:29.422384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054da32-abde-44a7-8ffa-bc6df9fe0d3f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:29.422897 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054da32-abde-44a7-8ffa-bc6df9fe0d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:29.423355 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054da32-abde-44a7-8ffa-bc6df9fe0d3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.426369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316692-f472-4d85-a5b6-a5b7b46e16c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:29.427038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316692-f472-4d85-a5b6-a5b7b46e16c7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:29.427322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316692-f472-4d85-a5b6-a5b7b46e16c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:29.427649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316692-f472-4d85-a5b6-a5b7b46e16c7 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.428490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a316692-f472-4d85-a5b6-a5b7b46e16c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:29.428802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a316692-f472-4d85-a5b6-a5b7b46e16c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:29.430264 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a316692-f472-4d85-a5b6-a5b7b46e16c7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:29.436086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054da32-abde-44a7-8ffa-bc6df9fe0d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:29.444237 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-4054da32-abde-44a7-8ffa-bc6df9fe0d3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:29.446728 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 304/629] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:29.447844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054da32-abde-44a7-8ffa-bc6df9fe0d3f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:29.449547 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 326/630] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Apr 12 14:06:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:29.453040 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316692-f472-4d85-a5b6-a5b7b46e16c7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:29.562824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316692-f472-4d85-a5b6-a5b7b46e16c7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:29.567060 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054da32-abde-44a7-8ffa-bc6df9fe0d3f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:29.598670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3f590-e279-40d8-9ffe-3cdd648eb2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:29.599642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f590-e279-40d8-9ffe-3cdd648eb2de None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:29.600062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f590-e279-40d8-9ffe-3cdd648eb2de None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:29.600471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f590-e279-40d8-9ffe-3cdd648eb2de None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.601483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3f590-e279-40d8-9ffe-3cdd648eb2de None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:29.602016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3f590-e279-40d8-9ffe-3cdd648eb2de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:29.603693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3f590-e279-40d8-9ffe-3cdd648eb2de None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:29.607835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c73519-7905-4716-b961-296955222da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:29.608520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73519-7905-4716-b961-296955222da7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:29.608807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73519-7905-4716-b961-296955222da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:29.609128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73519-7905-4716-b961-296955222da7 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.609917 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c73519-7905-4716-b961-296955222da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:29.610229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c73519-7905-4716-b961-296955222da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:29.613524 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c73519-7905-4716-b961-296955222da7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:29.616052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 327/631] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:29.617326 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3f590-e279-40d8-9ffe-3cdd648eb2de None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:29.633136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 305/632] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:29.633136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c73519-7905-4716-b961-296955222da7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:29.738014 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c73519-7905-4716-b961-296955222da7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:29.744212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3f590-e279-40d8-9ffe-3cdd648eb2de None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:29.778555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec1123-37eb-4289-8bc9-05a782e64199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:29.779720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec1123-37eb-4289-8bc9-05a782e64199 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:29.779823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5369228-012b-4c79-908e-bc0870c07f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:29.780372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec1123-37eb-4289-8bc9-05a782e64199 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:29.780540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5369228-012b-4c79-908e-bc0870c07f80 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:29.780823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5369228-012b-4c79-908e-bc0870c07f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:29.781124 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5369228-012b-4c79-908e-bc0870c07f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.781396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec1123-37eb-4289-8bc9-05a782e64199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.792913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec1123-37eb-4289-8bc9-05a782e64199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:29.793325 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5369228-012b-4c79-908e-bc0870c07f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:29.794863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5369228-012b-4c79-908e-bc0870c07f80 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:29.795227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec1123-37eb-4289-8bc9-05a782e64199 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:29.812155 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-4eec1123-37eb-4289-8bc9-05a782e64199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:29.814012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-a5369228-012b-4c79-908e-bc0870c07f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:29.814248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 328/633] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:29.815894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec1123-37eb-4289-8bc9-05a782e64199 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:29.815999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 306/634] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:29.819716 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5369228-012b-4c79-908e-bc0870c07f80 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:29.927653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec1123-37eb-4289-8bc9-05a782e64199 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:29.943821 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5369228-012b-4c79-908e-bc0870c07f80 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:29.963779 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3745d31-076a-49d0-9a46-79c0f2dba6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:29.964561 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745d31-076a-49d0-9a46-79c0f2dba6aa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:29.964738 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745d31-076a-49d0-9a46-79c0f2dba6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:29.965002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745d31-076a-49d0-9a46-79c0f2dba6aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.965851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3745d31-076a-49d0-9a46-79c0f2dba6aa None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=b9933c6dc8f74cd59f6a1f8c11abf652) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:29.966166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3745d31-076a-49d0-9a46-79c0f2dba6aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:29.967585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3745d31-076a-49d0-9a46-79c0f2dba6aa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:29.974160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 329/635] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:29 2022] GET /identity/v3/role_assignments?user.id=b9933c6dc8f74cd59f6a1f8c11abf652&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:29.975173 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3745d31-076a-49d0-9a46-79c0f2dba6aa None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:29.979902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100242e-ec95-4b53-94bd-234d5464ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:29.980804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100242e-ec95-4b53-94bd-234d5464ba22 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:29.981303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100242e-ec95-4b53-94bd-234d5464ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:29.981771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100242e-ec95-4b53-94bd-234d5464ba22 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:29.982693 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100242e-ec95-4b53-94bd-234d5464ba22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:29.983193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100242e-ec95-4b53-94bd-234d5464ba22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:29.984848 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100242e-ec95-4b53-94bd-234d5464ba22 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:29.998553 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 307/636] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:30.010081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100242e-ec95-4b53-94bd-234d5464ba22 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:30.108056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3745d31-076a-49d0-9a46-79c0f2dba6aa None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:30.133585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100242e-ec95-4b53-94bd-234d5464ba22 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:30.171256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f0dc5-535f-4f32-b7bb-a82eeb93c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:30.172465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f0dc5-535f-4f32-b7bb-a82eeb93c911 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:30.172940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f0dc5-535f-4f32-b7bb-a82eeb93c911 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:30.173512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f0dc5-535f-4f32-b7bb-a82eeb93c911 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:30.175480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0741617-2105-4452-a21b-214a2ce6da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:30.176223 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0741617-2105-4452-a21b-214a2ce6da2f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:30.176507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0741617-2105-4452-a21b-214a2ce6da2f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:30.176784 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0741617-2105-4452-a21b-214a2ce6da2f None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:30.177604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0741617-2105-4452-a21b-214a2ce6da2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:30.177916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0741617-2105-4452-a21b-214a2ce6da2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:30.179338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0741617-2105-4452-a21b-214a2ce6da2f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:30.183331 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f0dc5-535f-4f32-b7bb-a82eeb93c911 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:30.185017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f0dc5-535f-4f32-b7bb-a82eeb93c911 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:30.200675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-860f0dc5-535f-4f32-b7bb-a82eeb93c911 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:30.202535 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 308/638] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:30.202638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 330/638] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:30.209021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0741617-2105-4452-a21b-214a2ce6da2f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:30.210317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f0dc5-535f-4f32-b7bb-a82eeb93c911 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:30.319844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0741617-2105-4452-a21b-214a2ce6da2f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:30.330004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f0dc5-535f-4f32-b7bb-a82eeb93c911 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:30.356543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227e7e-0881-4d31-8afc-64f3e6f86093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:30.357389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227e7e-0881-4d31-8afc-64f3e6f86093 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:30.357674 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227e7e-0881-4d31-8afc-64f3e6f86093 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:30.357950 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227e7e-0881-4d31-8afc-64f3e6f86093 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:30.365479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227e7e-0881-4d31-8afc-64f3e6f86093 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:30.366930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227e7e-0881-4d31-8afc-64f3e6f86093 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:30.368892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f1da4-c6f9-4485-91a0-64ca2e9f6b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:30.369577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f1da4-c6f9-4485-91a0-64ca2e9f6b90 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:30.369856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f1da4-c6f9-4485-91a0-64ca2e9f6b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:30.370128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f1da4-c6f9-4485-91a0-64ca2e9f6b90 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:30.370902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f1da4-c6f9-4485-91a0-64ca2e9f6b90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:30.371210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f1da4-c6f9-4485-91a0-64ca2e9f6b90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:30.372612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f1da4-c6f9-4485-91a0-64ca2e9f6b90 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:30.382324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-da227e7e-0881-4d31-8afc-64f3e6f86093 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 14:06:30.385711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 309/640] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:30.386388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 331/640] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:30.387513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963e73a-342f-483f-9985-20c77b01953a None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:30.388011 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963e73a-342f-483f-9985-20c77b01953a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:30.388745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963e73a-342f-483f-9985-20c77b01953a None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:30.389442 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227e7e-0881-4d31-8afc-64f3e6f86093 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:30.390421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 310/641] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:30.391273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963e73a-342f-483f-9985-20c77b01953a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:30.512467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963e73a-342f-483f-9985-20c77b01953a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:30.520572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227e7e-0881-4d31-8afc-64f3e6f86093 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:30.548013 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40d28-d107-4ab8-9aa2-bd69599fb9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:30.548905 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40d28-d107-4ab8-9aa2-bd69599fb9ea None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:30.549381 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40d28-d107-4ab8-9aa2-bd69599fb9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:30.549824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40d28-d107-4ab8-9aa2-bd69599fb9ea None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/987dcad83b914b5894955dfe3e1f71ab/roles/316db11de3994c7b86fcc1bba9da56bc` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:30.562624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f73e71-7e63-4dab-b7eb-9d2726c40dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:30.563562 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f73e71-7e63-4dab-b7eb-9d2726c40dcf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:30.563847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f73e71-7e63-4dab-b7eb-9d2726c40dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:30.564125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f73e71-7e63-4dab-b7eb-9d2726c40dcf None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:30.565507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb40d28-d107-4ab8-9aa2-bd69599fb9ea None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=987dcad83b914b5894955dfe3e1f71ab, role_id=316db11de3994c7b86fcc1bba9da56bc)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:30.565636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f73e71-7e63-4dab-b7eb-9d2726c40dcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:30.565921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f73e71-7e63-4dab-b7eb-9d2726c40dcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:30.567229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb40d28-d107-4ab8-9aa2-bd69599fb9ea None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:30.567412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f73e71-7e63-4dab-b7eb-9d2726c40dcf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:30.589210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 332/642] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Apr 12 14:06:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:30.589210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506acf5-bd8c-4146-9ecd-e88ab3e2cc12 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:30.589210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506acf5-bd8c-4146-9ecd-e88ab3e2cc12 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:30.589210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506acf5-bd8c-4146-9ecd-e88ab3e2cc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:30.605048 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5506acf5-bd8c-4146-9ecd-e88ab3e2cc12 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:30.606213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5506acf5-bd8c-4146-9ecd-e88ab3e2cc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:30.662675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 311/643] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:06:30 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/987dcad83b914b5894955dfe3e1f71ab/roles/316db11de3994c7b86fcc1bba9da56bc => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:06:30.664407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40d28-d107-4ab8-9aa2-bd69599fb9ea None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:30.697434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 333/644] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:30.729098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506acf5-bd8c-4146-9ecd-e88ab3e2cc12 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:30.863710 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40d28-d107-4ab8-9aa2-bd69599fb9ea None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:30.903620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd44dd-e856-48b2-8d65-3ae1b1d10c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:30.905593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd44dd-e856-48b2-8d65-3ae1b1d10c1d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:30.905953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd44dd-e856-48b2-8d65-3ae1b1d10c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:30.906298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd44dd-e856-48b2-8d65-3ae1b1d10c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:30.907864 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506acf5-bd8c-4146-9ecd-e88ab3e2cc12 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:30.952088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116b1cf-d768-4acb-8514-d16af3676413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:30.952887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b1cf-d768-4acb-8514-d16af3676413 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:30.953225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b1cf-d768-4acb-8514-d16af3676413 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:30.953497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b1cf-d768-4acb-8514-d16af3676413 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:30.963786 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116b1cf-d768-4acb-8514-d16af3676413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:30.970771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-2116b1cf-d768-4acb-8514-d16af3676413 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:30.972371 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 334/645] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:30.978139 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc081-9515-474a-9be7-a48326487ac7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:30.978139 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc081-9515-474a-9be7-a48326487ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:30.978139 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc081-9515-474a-9be7-a48326487ac7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:30.978139 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 335/646] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:30.980660 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fc081-9515-474a-9be7-a48326487ac7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:31.006747 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd44dd-e856-48b2-8d65-3ae1b1d10c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:31.009267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd44dd-e856-48b2-8d65-3ae1b1d10c1d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:31.096075 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fc081-9515-474a-9be7-a48326487ac7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:31.126831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 312/647] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:31.128991 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115e72-ec1a-4f8f-a867-79e77eabbbb3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:31.129530 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115e72-ec1a-4f8f-a867-79e77eabbbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:31.130031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115e72-ec1a-4f8f-a867-79e77eabbbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:31.130425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330099cf-5684-4c1e-9b18-8fcf47d1bcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:31.131285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330099cf-5684-4c1e-9b18-8fcf47d1bcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:31.131636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330099cf-5684-4c1e-9b18-8fcf47d1bcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:31.131980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330099cf-5684-4c1e-9b18-8fcf47d1bcb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:31.132804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330099cf-5684-4c1e-9b18-8fcf47d1bcb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:31.133226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330099cf-5684-4c1e-9b18-8fcf47d1bcb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:31.134806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330099cf-5684-4c1e-9b18-8fcf47d1bcb7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:31.149104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 336/648] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:31.149104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330099cf-5684-4c1e-9b18-8fcf47d1bcb7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:31.157415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2f115e72-ec1a-4f8f-a867-79e77eabbbb3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:31.159179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2f115e72-ec1a-4f8f-a867-79e77eabbbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:31.233226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 313/649] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:31.234156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f115e72-ec1a-4f8f-a867-79e77eabbbb3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:31.269618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330099cf-5684-4c1e-9b18-8fcf47d1bcb7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:31.313131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e6463-93ff-45f4-8cea-d86f85625b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:31.314332 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e6463-93ff-45f4-8cea-d86f85625b78 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:31.315428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e6463-93ff-45f4-8cea-d86f85625b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:31.315850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e6463-93ff-45f4-8cea-d86f85625b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:31.331046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e6463-93ff-45f4-8cea-d86f85625b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:31.333451 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e6463-93ff-45f4-8cea-d86f85625b78 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:31.350237 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f115e72-ec1a-4f8f-a867-79e77eabbbb3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:31.354946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-875e6463-93ff-45f4-8cea-d86f85625b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:31.356584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 337/650] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:31.357626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e6463-93ff-45f4-8cea-d86f85625b78 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:31.391656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56b001-6f50-4550-bdbd-b0a29b12addd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:31.394569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56b001-6f50-4550-bdbd-b0a29b12addd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:31.395047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56b001-6f50-4550-bdbd-b0a29b12addd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:31.395467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56b001-6f50-4550-bdbd-b0a29b12addd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:31.410512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56b001-6f50-4550-bdbd-b0a29b12addd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:31.412245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56b001-6f50-4550-bdbd-b0a29b12addd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:31.436088 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-eb56b001-6f50-4550-bdbd-b0a29b12addd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:31.438204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 314/651] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:31.439119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56b001-6f50-4550-bdbd-b0a29b12addd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:31.466428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e6463-93ff-45f4-8cea-d86f85625b78 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:31.508791 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704baab2-93fd-4e73-b402-f903cc19a22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:31.510059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704baab2-93fd-4e73-b402-f903cc19a22c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:31.510929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704baab2-93fd-4e73-b402-f903cc19a22c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:31.511362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704baab2-93fd-4e73-b402-f903cc19a22c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:31.525115 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704baab2-93fd-4e73-b402-f903cc19a22c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:31.534781 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-704baab2-93fd-4e73-b402-f903cc19a22c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:31.536834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 338/652] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:31.537964 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704baab2-93fd-4e73-b402-f903cc19a22c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:31.547540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56b001-6f50-4550-bdbd-b0a29b12addd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:31.588026 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b2306-aaf8-40d0-a19e-34b04f4a4988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:31.589104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b2306-aaf8-40d0-a19e-34b04f4a4988 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:31.589389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b2306-aaf8-40d0-a19e-34b04f4a4988 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:31.589716 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b2306-aaf8-40d0-a19e-34b04f4a4988 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:31.590825 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b2306-aaf8-40d0-a19e-34b04f4a4988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:31.591139 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b2306-aaf8-40d0-a19e-34b04f4a4988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:31.593100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b2306-aaf8-40d0-a19e-34b04f4a4988 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:31.606295 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 315/653] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:31.607749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b2306-aaf8-40d0-a19e-34b04f4a4988 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:31.664208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704baab2-93fd-4e73-b402-f903cc19a22c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:31.711528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41638fb0-753f-4b47-a394-50a13b190800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:31.712610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41638fb0-753f-4b47-a394-50a13b190800 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:31.713012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41638fb0-753f-4b47-a394-50a13b190800 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:31.713393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41638fb0-753f-4b47-a394-50a13b190800 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:31.714711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41638fb0-753f-4b47-a394-50a13b190800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:31.715129 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41638fb0-753f-4b47-a394-50a13b190800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:31.717050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41638fb0-753f-4b47-a394-50a13b190800 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:31.723915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b2306-aaf8-40d0-a19e-34b04f4a4988 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:31.737595 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 339/654] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:31.737595 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41638fb0-753f-4b47-a394-50a13b190800 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:31.763610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf3546-8642-4f87-9b57-65f3242bb988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:31.764616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf3546-8642-4f87-9b57-65f3242bb988 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:31.765192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf3546-8642-4f87-9b57-65f3242bb988 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:31.765719 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf3546-8642-4f87-9b57-65f3242bb988 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:31.766642 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf3546-8642-4f87-9b57-65f3242bb988 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:31.767187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf3546-8642-4f87-9b57-65f3242bb988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:31.769210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf3546-8642-4f87-9b57-65f3242bb988 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:31.782986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 316/655] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:31.784563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf3546-8642-4f87-9b57-65f3242bb988 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:31.855517 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41638fb0-753f-4b47-a394-50a13b190800 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:31.894089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf3546-8642-4f87-9b57-65f3242bb988 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:31.899330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccddeea-6e31-45eb-88a2-39ee1ba682cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:31.900151 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccddeea-6e31-45eb-88a2-39ee1ba682cb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:31.900437 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccddeea-6e31-45eb-88a2-39ee1ba682cb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:31.900711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccddeea-6e31-45eb-88a2-39ee1ba682cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:31.908320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccddeea-6e31-45eb-88a2-39ee1ba682cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:31.910660 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccddeea-6e31-45eb-88a2-39ee1ba682cb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:31.924651 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-bccddeea-6e31-45eb-88a2-39ee1ba682cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:31.926242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 340/656] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:31.927021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccddeea-6e31-45eb-88a2-39ee1ba682cb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:31.934499 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51910f0b-2c8c-4a10-8c63-dc5608b8e426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:31.935301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51910f0b-2c8c-4a10-8c63-dc5608b8e426 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:31.935583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51910f0b-2c8c-4a10-8c63-dc5608b8e426 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:31.935860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51910f0b-2c8c-4a10-8c63-dc5608b8e426 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:31.947277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51910f0b-2c8c-4a10-8c63-dc5608b8e426 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:31.948749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51910f0b-2c8c-4a10-8c63-dc5608b8e426 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:31.967410 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-51910f0b-2c8c-4a10-8c63-dc5608b8e426 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 14:06:31.969270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 317/657] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:31.970424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51910f0b-2c8c-4a10-8c63-dc5608b8e426 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:32.037073 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccddeea-6e31-45eb-88a2-39ee1ba682cb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:32.076616 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab121a3-d41e-4397-91cb-25a92aec2978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:32.077453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab121a3-d41e-4397-91cb-25a92aec2978 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:32.077736 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab121a3-d41e-4397-91cb-25a92aec2978 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:32.078011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab121a3-d41e-4397-91cb-25a92aec2978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:32.080116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51910f0b-2c8c-4a10-8c63-dc5608b8e426 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:32.089831 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab121a3-d41e-4397-91cb-25a92aec2978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:32.091337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab121a3-d41e-4397-91cb-25a92aec2978 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:32.108642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-eab121a3-d41e-4397-91cb-25a92aec2978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:32.110185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 341/658] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:32.111021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab121a3-d41e-4397-91cb-25a92aec2978 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:32.120030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190eb1ad-8bfe-45f5-acd0-4ac4bd2dd3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:32.121131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eb1ad-8bfe-45f5-acd0-4ac4bd2dd3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:32.121416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eb1ad-8bfe-45f5-acd0-4ac4bd2dd3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:32.121697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eb1ad-8bfe-45f5-acd0-4ac4bd2dd3e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:32.122844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190eb1ad-8bfe-45f5-acd0-4ac4bd2dd3e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:32.123157 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190eb1ad-8bfe-45f5-acd0-4ac4bd2dd3e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:32.125231 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190eb1ad-8bfe-45f5-acd0-4ac4bd2dd3e0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:32.141805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 318/659] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:32.143622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190eb1ad-8bfe-45f5-acd0-4ac4bd2dd3e0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:32.212351 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab121a3-d41e-4397-91cb-25a92aec2978 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:32.249211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bf7cf-2054-4a9a-9098-ee674c5a3422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:32.250006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bf7cf-2054-4a9a-9098-ee674c5a3422 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:32.250360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bf7cf-2054-4a9a-9098-ee674c5a3422 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:32.250705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bf7cf-2054-4a9a-9098-ee674c5a3422 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:32.251639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bf7cf-2054-4a9a-9098-ee674c5a3422 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:32.252021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bf7cf-2054-4a9a-9098-ee674c5a3422 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:32.254035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bf7cf-2054-4a9a-9098-ee674c5a3422 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:32.269143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190eb1ad-8bfe-45f5-acd0-4ac4bd2dd3e0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:32.275449 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 342/660] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Apr 12 14:06:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:32.276372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bf7cf-2054-4a9a-9098-ee674c5a3422 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:32.308280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3514dfe-a6a0-4945-a1d6-5b3a14587dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:32.309071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3514dfe-a6a0-4945-a1d6-5b3a14587dbc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:32.309421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3514dfe-a6a0-4945-a1d6-5b3a14587dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:32.309764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3514dfe-a6a0-4945-a1d6-5b3a14587dbc None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:32.310625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3514dfe-a6a0-4945-a1d6-5b3a14587dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:32.311015 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3514dfe-a6a0-4945-a1d6-5b3a14587dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:32.312506 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3514dfe-a6a0-4945-a1d6-5b3a14587dbc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:32.325902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 319/661] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:32.326987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3514dfe-a6a0-4945-a1d6-5b3a14587dbc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:32.401364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bf7cf-2054-4a9a-9098-ee674c5a3422 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:32.436324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d1fcd-ce36-465c-bb06-c4e3d0177e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:32.436995 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1fcd-ce36-465c-bb06-c4e3d0177e1b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:32.437310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1fcd-ce36-465c-bb06-c4e3d0177e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:32.437589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1fcd-ce36-465c-bb06-c4e3d0177e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:32.437767 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3514dfe-a6a0-4945-a1d6-5b3a14587dbc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:32.438418 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d1fcd-ce36-465c-bb06-c4e3d0177e1b None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=21ef8bbd229c488d97f167c810bc7cfd) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:32.438730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d1fcd-ce36-465c-bb06-c4e3d0177e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:32.441461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d1fcd-ce36-465c-bb06-c4e3d0177e1b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:32.453098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 343/662] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:32 2022] GET /identity/v3/role_assignments?user.id=21ef8bbd229c488d97f167c810bc7cfd&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:32.454036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d1fcd-ce36-465c-bb06-c4e3d0177e1b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:32.477517 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2304d-1e5a-4944-8d2f-4e39fdab59c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:32.478094 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2304d-1e5a-4944-8d2f-4e39fdab59c2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:32.478381 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2304d-1e5a-4944-8d2f-4e39fdab59c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:32.478654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2304d-1e5a-4944-8d2f-4e39fdab59c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:32.570861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2304d-1e5a-4944-8d2f-4e39fdab59c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:32.572606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2304d-1e5a-4944-8d2f-4e39fdab59c2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:32.693276 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d1fcd-ce36-465c-bb06-c4e3d0177e1b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:32.700252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 320/663] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:32.702176 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513fc06-b135-4578-a78e-da74f930a592 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:32.702469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513fc06-b135-4578-a78e-da74f930a592 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:32.702751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513fc06-b135-4578-a78e-da74f930a592 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:32.705071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 321/664] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:32.706920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513fc06-b135-4578-a78e-da74f930a592 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:32.738169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcedec-51f4-4b85-8209-725d085a8e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:32.739324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcedec-51f4-4b85-8209-725d085a8e1b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:32.739508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcedec-51f4-4b85-8209-725d085a8e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:32.739748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcedec-51f4-4b85-8209-725d085a8e1b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:32.748493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcedec-51f4-4b85-8209-725d085a8e1b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:32.750523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcedec-51f4-4b85-8209-725d085a8e1b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:32.766981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-a1bcedec-51f4-4b85-8209-725d085a8e1b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 14:06:32.773020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 344/665] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:32.773020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288e691-92f3-4fa7-a078-4c9d83b4802d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:32.773020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288e691-92f3-4fa7-a078-4c9d83b4802d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:32.773020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288e691-92f3-4fa7-a078-4c9d83b4802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:32.793097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b288e691-92f3-4fa7-a078-4c9d83b4802d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:32.794274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b288e691-92f3-4fa7-a078-4c9d83b4802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:32.846637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513fc06-b135-4578-a78e-da74f930a592 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:32.872010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 345/666] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:32.873275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288e691-92f3-4fa7-a078-4c9d83b4802d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:32.908088 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de826c-ba7b-4043-b0e6-07d2dfb8a730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:32.910266 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de826c-ba7b-4043-b0e6-07d2dfb8a730 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:32.910549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de826c-ba7b-4043-b0e6-07d2dfb8a730 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:32.910824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de826c-ba7b-4043-b0e6-07d2dfb8a730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:32.923086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de826c-ba7b-4043-b0e6-07d2dfb8a730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:32.924989 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de826c-ba7b-4043-b0e6-07d2dfb8a730 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:32.947445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-56de826c-ba7b-4043-b0e6-07d2dfb8a730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:32.949243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 322/667] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:32.954672 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de826c-ba7b-4043-b0e6-07d2dfb8a730 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:32.998334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288e691-92f3-4fa7-a078-4c9d83b4802d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:33.043311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c71bf7-6fa8-4ae7-8591-04a34fb78fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:33.044748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c71bf7-6fa8-4ae7-8591-04a34fb78fdf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.045336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c71bf7-6fa8-4ae7-8591-04a34fb78fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.046078 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c71bf7-6fa8-4ae7-8591-04a34fb78fdf None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.047308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c71bf7-6fa8-4ae7-8591-04a34fb78fdf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:33.048115 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c71bf7-6fa8-4ae7-8591-04a34fb78fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:33.050614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c71bf7-6fa8-4ae7-8591-04a34fb78fdf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:33.059599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de826c-ba7b-4043-b0e6-07d2dfb8a730 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:33.073970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 346/668] 10.222.0.61 () {56 vars in 1139 bytes} [Tue Apr 12 14:06:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:33.074852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c71bf7-6fa8-4ae7-8591-04a34fb78fdf None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:33.104849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d2ab-77dc-4915-90a2-6f2f48a1fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:33.106589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d2ab-77dc-4915-90a2-6f2f48a1fb23 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.107102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d2ab-77dc-4915-90a2-6f2f48a1fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.107589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d2ab-77dc-4915-90a2-6f2f48a1fb23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.124301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69d2ab-77dc-4915-90a2-6f2f48a1fb23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:33.134881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-1e69d2ab-77dc-4915-90a2-6f2f48a1fb23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:06:33.137420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 323/669] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:33.138400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d2ab-77dc-4915-90a2-6f2f48a1fb23 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:33.175110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c71bf7-6fa8-4ae7-8591-04a34fb78fdf None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:33.208920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0895a2-c1de-4e2e-8298-64b2ced36530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:33.209898 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0895a2-c1de-4e2e-8298-64b2ced36530 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.210378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0895a2-c1de-4e2e-8298-64b2ced36530 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.210869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0895a2-c1de-4e2e-8298-64b2ced36530 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.211771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0895a2-c1de-4e2e-8298-64b2ced36530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:33.212266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0895a2-c1de-4e2e-8298-64b2ced36530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:33.213827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0895a2-c1de-4e2e-8298-64b2ced36530 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:33.226059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 347/670] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:33.227108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0895a2-c1de-4e2e-8298-64b2ced36530 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:33.244819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d2ab-77dc-4915-90a2-6f2f48a1fb23 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:33.278462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6db36-2a31-4330-8343-caed791e0987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:33.279055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6db36-2a31-4330-8343-caed791e0987 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.279304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6db36-2a31-4330-8343-caed791e0987 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.279576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6db36-2a31-4330-8343-caed791e0987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.324955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0895a2-c1de-4e2e-8298-64b2ced36530 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:33.346653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6db36-2a31-4330-8343-caed791e0987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:33.348118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6db36-2a31-4330-8343-caed791e0987 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:33.359688 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6c604-329f-4b09-bd82-13947747d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:33.360359 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6c604-329f-4b09-bd82-13947747d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.360644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6c604-329f-4b09-bd82-13947747d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.360927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6c604-329f-4b09-bd82-13947747d6f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.361797 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6c604-329f-4b09-bd82-13947747d6f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:33.362021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6c604-329f-4b09-bd82-13947747d6f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:33.363401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6c604-329f-4b09-bd82-13947747d6f5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:33.372609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 348/671] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:33.374119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae733b-a085-47f1-bdc4-bff2095e44bb None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.374580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae733b-a085-47f1-bdc4-bff2095e44bb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.375025 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae733b-a085-47f1-bdc4-bff2095e44bb None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.376427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 349/672] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:33.377360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae733b-a085-47f1-bdc4-bff2095e44bb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:33.456873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 324/673] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:33.457850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6db36-2a31-4330-8343-caed791e0987 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:33.484875 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae733b-a085-47f1-bdc4-bff2095e44bb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:33.519917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e103b-c76b-493d-8088-dcb8a316815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:33.520714 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e103b-c76b-493d-8088-dcb8a316815f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.521026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e103b-c76b-493d-8088-dcb8a316815f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.521311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e103b-c76b-493d-8088-dcb8a316815f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.528728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e103b-c76b-493d-8088-dcb8a316815f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:33.530138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e103b-c76b-493d-8088-dcb8a316815f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:33.543315 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-3c7e103b-c76b-493d-8088-dcb8a316815f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:33.544736 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 350/674] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:33.545806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c4acf-d81e-4519-bc74-16cf2fcaf723 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.546086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c4acf-d81e-4519-bc74-16cf2fcaf723 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.546361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c4acf-d81e-4519-bc74-16cf2fcaf723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.563711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f55c4acf-d81e-4519-bc74-16cf2fcaf723 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:33.565416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f55c4acf-d81e-4519-bc74-16cf2fcaf723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:33.571617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6db36-2a31-4330-8343-caed791e0987 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:33.606171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376240-cbfa-40d0-8553-a6eaf41caacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:33.606963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376240-cbfa-40d0-8553-a6eaf41caacb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.607253 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376240-cbfa-40d0-8553-a6eaf41caacb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.607528 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376240-cbfa-40d0-8553-a6eaf41caacb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.617844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82376240-cbfa-40d0-8553-a6eaf41caacb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:33.619372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82376240-cbfa-40d0-8553-a6eaf41caacb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:33.637009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 351/675] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:33.637009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c4acf-d81e-4519-bc74-16cf2fcaf723 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:33.637239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-82376240-cbfa-40d0-8553-a6eaf41caacb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:33.642171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 325/676] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:33.643543 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376240-cbfa-40d0-8553-a6eaf41caacb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:33.747596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c4acf-d81e-4519-bc74-16cf2fcaf723 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:33.750814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376240-cbfa-40d0-8553-a6eaf41caacb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:33.782530 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984575fa-5ece-41ad-9033-6d601a90b08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:33.784229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984575fa-5ece-41ad-9033-6d601a90b08f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.784999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984575fa-5ece-41ad-9033-6d601a90b08f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.785285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984575fa-5ece-41ad-9033-6d601a90b08f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.789250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfd1f4-15c5-4933-bb0a-b48c0db51fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:33.789913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd1f4-15c5-4933-bb0a-b48c0db51fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.790200 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd1f4-15c5-4933-bb0a-b48c0db51fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.790482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd1f4-15c5-4933-bb0a-b48c0db51fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.791261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfd1f4-15c5-4933-bb0a-b48c0db51fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:33.791572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfd1f4-15c5-4933-bb0a-b48c0db51fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:33.793019 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfd1f4-15c5-4933-bb0a-b48c0db51fd9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:33.795767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984575fa-5ece-41ad-9033-6d601a90b08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:33.797230 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984575fa-5ece-41ad-9033-6d601a90b08f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:33.810016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 326/677] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:33.810016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfd1f4-15c5-4933-bb0a-b48c0db51fd9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:33.820105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-984575fa-5ece-41ad-9033-6d601a90b08f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:33.821602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 352/678] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:33.822449 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984575fa-5ece-41ad-9033-6d601a90b08f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:33.910291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfd1f4-15c5-4933-bb0a-b48c0db51fd9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:33.927105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984575fa-5ece-41ad-9033-6d601a90b08f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:33.943803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926e35-5683-4637-b20c-a23235219a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:33.944466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926e35-5683-4637-b20c-a23235219a35 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.944754 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926e35-5683-4637-b20c-a23235219a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.945058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926e35-5683-4637-b20c-a23235219a35 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.945772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926e35-5683-4637-b20c-a23235219a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:33.946332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926e35-5683-4637-b20c-a23235219a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:33.947695 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926e35-5683-4637-b20c-a23235219a35 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:33.959865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 327/679] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:33.960738 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926e35-5683-4637-b20c-a23235219a35 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:33.965056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dd3b3-2fc0-4f0b-a6a0-7cb2e6116b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:33.965860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dd3b3-2fc0-4f0b-a6a0-7cb2e6116b90 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:33.966144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dd3b3-2fc0-4f0b-a6a0-7cb2e6116b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:33.966422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dd3b3-2fc0-4f0b-a6a0-7cb2e6116b90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:33.979380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2dd3b3-2fc0-4f0b-a6a0-7cb2e6116b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:33.986367 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-1c2dd3b3-2fc0-4f0b-a6a0-7cb2e6116b90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:33.987571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 353/680] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:33.988302 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dd3b3-2fc0-4f0b-a6a0-7cb2e6116b90 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:34.060422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926e35-5683-4637-b20c-a23235219a35 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:34.090668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dd3b3-2fc0-4f0b-a6a0-7cb2e6116b90 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:34.093674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5192115-4c51-498a-a073-fbcd03167455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:34.094325 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5192115-4c51-498a-a073-fbcd03167455 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:34.094613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5192115-4c51-498a-a073-fbcd03167455 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:34.094951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5192115-4c51-498a-a073-fbcd03167455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:34.096432 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5192115-4c51-498a-a073-fbcd03167455 None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=c6ca11a750dc4234b4512e6274ca01a5) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:34.096752 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5192115-4c51-498a-a073-fbcd03167455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:34.098217 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5192115-4c51-498a-a073-fbcd03167455 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:34.113001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 328/681] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:33 2022] GET /identity/v3/role_assignments?user.id=c6ca11a750dc4234b4512e6274ca01a5&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:34.113001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5192115-4c51-498a-a073-fbcd03167455 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:34.139434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9bd7c-caa2-438d-bb0b-4ae9dae4dfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:34.140349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9bd7c-caa2-438d-bb0b-4ae9dae4dfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:34.140637 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9bd7c-caa2-438d-bb0b-4ae9dae4dfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:34.141405 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9bd7c-caa2-438d-bb0b-4ae9dae4dfe7 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:34.142498 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9bd7c-caa2-438d-bb0b-4ae9dae4dfe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:34.143341 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9bd7c-caa2-438d-bb0b-4ae9dae4dfe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:34.145578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9bd7c-caa2-438d-bb0b-4ae9dae4dfe7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:34.162811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 354/682] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:34.163987 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9bd7c-caa2-438d-bb0b-4ae9dae4dfe7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:34.240111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5192115-4c51-498a-a073-fbcd03167455 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:34.289267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc0cb1-672b-491d-b7a3-7268219efb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:34.290354 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc0cb1-672b-491d-b7a3-7268219efb33 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:34.290644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc0cb1-672b-491d-b7a3-7268219efb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:34.290925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc0cb1-672b-491d-b7a3-7268219efb33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:34.295843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9bd7c-caa2-438d-bb0b-4ae9dae4dfe7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:34.302101 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc0cb1-672b-491d-b7a3-7268219efb33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:34.303577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc0cb1-672b-491d-b7a3-7268219efb33 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:34.328312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-73fc0cb1-672b-491d-b7a3-7268219efb33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 14:06:34.330880 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 329/683] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Apr 12 14:06:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:34.332091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc0cb1-672b-491d-b7a3-7268219efb33 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:34.343139 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a3084-b021-4578-9fcd-7decaf81117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:34.344424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3084-b021-4578-9fcd-7decaf81117b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:34.344856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3084-b021-4578-9fcd-7decaf81117b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:34.345608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3084-b021-4578-9fcd-7decaf81117b None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:34.347063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a3084-b021-4578-9fcd-7decaf81117b None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:34.347524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a3084-b021-4578-9fcd-7decaf81117b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:34.349373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a3084-b021-4578-9fcd-7decaf81117b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:34.358088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 355/684] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:34.358888 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a3084-b021-4578-9fcd-7decaf81117b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:34.445612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc0cb1-672b-491d-b7a3-7268219efb33 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:34.479438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a3084-b021-4578-9fcd-7decaf81117b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:34.479857 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd7316-3ae1-4cc0-a3c3-ee8889dc4f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:34.480653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd7316-3ae1-4cc0-a3c3-ee8889dc4f27 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:34.480940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd7316-3ae1-4cc0-a3c3-ee8889dc4f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:34.481251 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd7316-3ae1-4cc0-a3c3-ee8889dc4f27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:34.488755 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd7316-3ae1-4cc0-a3c3-ee8889dc4f27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:34.490444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd7316-3ae1-4cc0-a3c3-ee8889dc4f27 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:34.505926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-e0cd7316-3ae1-4cc0-a3c3-ee8889dc4f27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:34.507520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 330/685] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:34.508301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd7316-3ae1-4cc0-a3c3-ee8889dc4f27 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:34.519286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e1cf0-f2da-4c3f-8537-586c7be7bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:34.519964 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e1cf0-f2da-4c3f-8537-586c7be7bc3d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:34.520247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e1cf0-f2da-4c3f-8537-586c7be7bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:34.520524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e1cf0-f2da-4c3f-8537-586c7be7bc3d None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:34.521397 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e1cf0-f2da-4c3f-8537-586c7be7bc3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:34.521709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e1cf0-f2da-4c3f-8537-586c7be7bc3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:34.523168 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e1cf0-f2da-4c3f-8537-586c7be7bc3d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:34.541862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 356/686] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Apr 12 14:06:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:34.542771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e1cf0-f2da-4c3f-8537-586c7be7bc3d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:34.615770 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd7316-3ae1-4cc0-a3c3-ee8889dc4f27 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:34.648787 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e1cf0-f2da-4c3f-8537-586c7be7bc3d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:34.651161 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de309e-b29a-4d56-99fd-836b52abd1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:34.651963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de309e-b29a-4d56-99fd-836b52abd1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:34.652244 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de309e-b29a-4d56-99fd-836b52abd1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:34.652515 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de309e-b29a-4d56-99fd-836b52abd1c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:34.666565 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de309e-b29a-4d56-99fd-836b52abd1c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:34.668273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de309e-b29a-4d56-99fd-836b52abd1c5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:34.683845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce8df6-ab81-4bb1-8c42-217a5a35bceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:34.684502 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce8df6-ab81-4bb1-8c42-217a5a35bceb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:34.684789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce8df6-ab81-4bb1-8c42-217a5a35bceb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:34.685103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce8df6-ab81-4bb1-8c42-217a5a35bceb None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:34.685869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce8df6-ab81-4bb1-8c42-217a5a35bceb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:34.686180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce8df6-ab81-4bb1-8c42-217a5a35bceb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:34.687594 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce8df6-ab81-4bb1-8c42-217a5a35bceb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:34.694383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-93de309e-b29a-4d56-99fd-836b52abd1c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:34.700593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 357/688] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:34.700940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce8df6-ab81-4bb1-8c42-217a5a35bceb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:34.701166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 331/688] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:34.707092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de309e-b29a-4d56-99fd-836b52abd1c5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:34.804466 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce8df6-ab81-4bb1-8c42-217a5a35bceb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:34.807318 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de309e-b29a-4d56-99fd-836b52abd1c5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:34.838444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b229a0-f6f1-4d56-a941-28f2652099b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:34.839100 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b229a0-f6f1-4d56-a941-28f2652099b6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:34.839482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b229a0-f6f1-4d56-a941-28f2652099b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:34.839712 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b229a0-f6f1-4d56-a941-28f2652099b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:34.843087 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d8be1-4d1e-47ff-9ae6-5b2d4e91c01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:34.843910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d8be1-4d1e-47ff-9ae6-5b2d4e91c01d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:34.844356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d8be1-4d1e-47ff-9ae6-5b2d4e91c01d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:34.844776 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d8be1-4d1e-47ff-9ae6-5b2d4e91c01d None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:34.846356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d8be1-4d1e-47ff-9ae6-5b2d4e91c01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:34.846859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d8be1-4d1e-47ff-9ae6-5b2d4e91c01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:34.848407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d8be1-4d1e-47ff-9ae6-5b2d4e91c01d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:34.865071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 332/689] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:34.866193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d8be1-4d1e-47ff-9ae6-5b2d4e91c01d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:34.908445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b229a0-f6f1-4d56-a941-28f2652099b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:34.910279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b229a0-f6f1-4d56-a941-28f2652099b6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:34.967493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d8be1-4d1e-47ff-9ae6-5b2d4e91c01d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:35.001801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483b19a-b0ff-4e66-895b-bf079247ea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:35.003156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483b19a-b0ff-4e66-895b-bf079247ea1c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:35.003445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483b19a-b0ff-4e66-895b-bf079247ea1c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:35.003726 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483b19a-b0ff-4e66-895b-bf079247ea1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:35.004554 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483b19a-b0ff-4e66-895b-bf079247ea1c None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=fa7ee0856f4644c994c3ccbd400b6fbb) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:35.004897 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483b19a-b0ff-4e66-895b-bf079247ea1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:35.006342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483b19a-b0ff-4e66-895b-bf079247ea1c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:35.010332 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 358/690] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:35.011012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b229a0-f6f1-4d56-a941-28f2652099b6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:35.025171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 333/691] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:34 2022] GET /identity/v3/role_assignments?user.id=fa7ee0856f4644c994c3ccbd400b6fbb&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:35.026706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91120-2a03-4cef-a285-3bcaf9982753 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:35.026999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91120-2a03-4cef-a285-3bcaf9982753 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:35.027281 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91120-2a03-4cef-a285-3bcaf9982753 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:35.032723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 334/692] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:35.032723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d91120-2a03-4cef-a285-3bcaf9982753 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:35.129000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b229a0-f6f1-4d56-a941-28f2652099b6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:35.144296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d91120-2a03-4cef-a285-3bcaf9982753 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:35.167220 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468fe80-d2d7-4a79-821b-64205ac3aff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:35.168380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468fe80-d2d7-4a79-821b-64205ac3aff7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:35.168869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468fe80-d2d7-4a79-821b-64205ac3aff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:35.169401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468fe80-d2d7-4a79-821b-64205ac3aff7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:35.178247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468fe80-d2d7-4a79-821b-64205ac3aff7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:35.180028 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468fe80-d2d7-4a79-821b-64205ac3aff7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:35.183028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f96451-33fa-4642-8b22-5fa59b3f61a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:35.183028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f96451-33fa-4642-8b22-5fa59b3f61a2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:35.183322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f96451-33fa-4642-8b22-5fa59b3f61a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:35.183396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f96451-33fa-4642-8b22-5fa59b3f61a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:35.195879 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f96451-33fa-4642-8b22-5fa59b3f61a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:35.198026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-e468fe80-d2d7-4a79-821b-64205ac3aff7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 14:06:35.198142 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f96451-33fa-4642-8b22-5fa59b3f61a2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:35.204948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 359/693] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:35.207173 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff228-c5da-465e-a240-c5509c7ef9d3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:35.207686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff228-c5da-465e-a240-c5509c7ef9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:35.208162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff228-c5da-465e-a240-c5509c7ef9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:35.217420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-c3f96451-33fa-4642-8b22-5fa59b3f61a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:35.223396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 335/694] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:35.223396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f96451-33fa-4642-8b22-5fa59b3f61a2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:35.231746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d6bff228-c5da-465e-a240-c5509c7ef9d3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:35.233270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d6bff228-c5da-465e-a240-c5509c7ef9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:35.332996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 360/695] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:35.332996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff228-c5da-465e-a240-c5509c7ef9d3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:35.350413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f96451-33fa-4642-8b22-5fa59b3f61a2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:35.391619 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66697b3-d628-4252-9fdc-ab2eb7906737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:35.393211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66697b3-d628-4252-9fdc-ab2eb7906737 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:35.394093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66697b3-d628-4252-9fdc-ab2eb7906737 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:35.394614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66697b3-d628-4252-9fdc-ab2eb7906737 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:35.396832 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66697b3-d628-4252-9fdc-ab2eb7906737 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:35.397479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66697b3-d628-4252-9fdc-ab2eb7906737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:35.399886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66697b3-d628-4252-9fdc-ab2eb7906737 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:35.425139 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 336/696] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Apr 12 14:06:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:35.425139 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66697b3-d628-4252-9fdc-ab2eb7906737 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:35.462794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff228-c5da-465e-a240-c5509c7ef9d3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:35.505440 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f7365-e165-47b0-b619-784e4c4c8bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:35.506280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7365-e165-47b0-b619-784e4c4c8bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:35.506665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7365-e165-47b0-b619-784e4c4c8bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:35.507201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7365-e165-47b0-b619-784e4c4c8bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:35.508045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f7365-e165-47b0-b619-784e4c4c8bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:35.508832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f7365-e165-47b0-b619-784e4c4c8bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:35.510536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f7365-e165-47b0-b619-784e4c4c8bc2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:35.529060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 361/697] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:35.530942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f7365-e165-47b0-b619-784e4c4c8bc2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:35.545678 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66697b3-d628-4252-9fdc-ab2eb7906737 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:35.579899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319039c-9721-4fde-a923-3a4c2baf3c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:35.581664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319039c-9721-4fde-a923-3a4c2baf3c32 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:35.582114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319039c-9721-4fde-a923-3a4c2baf3c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:35.582614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319039c-9721-4fde-a923-3a4c2baf3c32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:35.592738 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319039c-9721-4fde-a923-3a4c2baf3c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:35.594481 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319039c-9721-4fde-a923-3a4c2baf3c32 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:35.612296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-3319039c-9721-4fde-a923-3a4c2baf3c32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:35.614078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 337/698] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:35.615031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319039c-9721-4fde-a923-3a4c2baf3c32 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:35.660127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f7365-e165-47b0-b619-784e4c4c8bc2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:35.705943 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4227a8a-acf6-4421-9f97-352f1d4314fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:35.706635 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4227a8a-acf6-4421-9f97-352f1d4314fe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:35.706922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4227a8a-acf6-4421-9f97-352f1d4314fe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:35.707200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4227a8a-acf6-4421-9f97-352f1d4314fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:35.722337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319039c-9721-4fde-a923-3a4c2baf3c32 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:35.756472 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938f4af-3533-4337-9387-855a1703907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:35.757632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938f4af-3533-4337-9387-855a1703907e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:35.758139 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938f4af-3533-4337-9387-855a1703907e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:35.758664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938f4af-3533-4337-9387-855a1703907e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:35.765934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938f4af-3533-4337-9387-855a1703907e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:35.767871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938f4af-3533-4337-9387-855a1703907e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:35.781528 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-6938f4af-3533-4337-9387-855a1703907e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:35.788480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4227a8a-acf6-4421-9f97-352f1d4314fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:35.788480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4227a8a-acf6-4421-9f97-352f1d4314fe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:35.788838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 338/699] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:35.789918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938f4af-3533-4337-9387-855a1703907e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:35.891363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938f4af-3533-4337-9387-855a1703907e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:35.913134 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 362/700] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:35.914382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4227a8a-acf6-4421-9f97-352f1d4314fe None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:35.927777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e84a99-03db-4835-8885-6e7883835929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:35.928451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e84a99-03db-4835-8885-6e7883835929 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:35.928777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e84a99-03db-4835-8885-6e7883835929 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:35.929099 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e84a99-03db-4835-8885-6e7883835929 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:35.929822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e84a99-03db-4835-8885-6e7883835929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:35.930130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e84a99-03db-4835-8885-6e7883835929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:35.931511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e84a99-03db-4835-8885-6e7883835929 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:35.945613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 339/701] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:35.947339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e84a99-03db-4835-8885-6e7883835929 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:36.045793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4227a8a-acf6-4421-9f97-352f1d4314fe None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:36.048026 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e84a99-03db-4835-8885-6e7883835929 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:36.084073 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35f9af-cfd2-4c9d-8b98-7e8345c5f603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:36.085070 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35f9af-cfd2-4c9d-8b98-7e8345c5f603 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:36.085457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35f9af-cfd2-4c9d-8b98-7e8345c5f603 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:36.085831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35f9af-cfd2-4c9d-8b98-7e8345c5f603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:36.087271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9e1af-05a7-44af-926f-7d4654d7940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:36.088117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9e1af-05a7-44af-926f-7d4654d7940b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:36.088408 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9e1af-05a7-44af-926f-7d4654d7940b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:36.088688 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9e1af-05a7-44af-926f-7d4654d7940b None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:36.090735 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9e1af-05a7-44af-926f-7d4654d7940b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:36.091053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9e1af-05a7-44af-926f-7d4654d7940b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:36.092496 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9e1af-05a7-44af-926f-7d4654d7940b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:36.097468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35f9af-cfd2-4c9d-8b98-7e8345c5f603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:36.099068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35f9af-cfd2-4c9d-8b98-7e8345c5f603 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:36.107287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 363/702] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:36.108662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9e1af-05a7-44af-926f-7d4654d7940b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:36.124303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-0f35f9af-cfd2-4c9d-8b98-7e8345c5f603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:36.125958 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 340/703] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:36.127507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35f9af-cfd2-4c9d-8b98-7e8345c5f603 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:36.217103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9e1af-05a7-44af-926f-7d4654d7940b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:36.259659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398fa46-af64-495b-a38f-7c1ce16b77b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:36.260709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398fa46-af64-495b-a38f-7c1ce16b77b5 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:36.261239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398fa46-af64-495b-a38f-7c1ce16b77b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:36.261737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398fa46-af64-495b-a38f-7c1ce16b77b5 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:36.262648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398fa46-af64-495b-a38f-7c1ce16b77b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:36.264309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398fa46-af64-495b-a38f-7c1ce16b77b5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:36.265355 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35f9af-cfd2-4c9d-8b98-7e8345c5f603 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:36.300880 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b842-bc6c-4cb2-b5cc-956d12b816c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:36.301577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b842-bc6c-4cb2-b5cc-956d12b816c9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:36.301865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b842-bc6c-4cb2-b5cc-956d12b816c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:36.302145 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b842-bc6c-4cb2-b5cc-956d12b816c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:36.302976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5b842-bc6c-4cb2-b5cc-956d12b816c9 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=b9933c6dc8f74cd59f6a1f8c11abf652) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:36.303288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5b842-bc6c-4cb2-b5cc-956d12b816c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:36.304769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5b842-bc6c-4cb2-b5cc-956d12b816c9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:36.317115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 341/704] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:36 2022] GET /identity/v3/role_assignments?user.id=b9933c6dc8f74cd59f6a1f8c11abf652&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:36.317115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b842-bc6c-4cb2-b5cc-956d12b816c9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:36.370426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 364/705] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:06:36 2022] POST /identity/v3/users => generated 254 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:36.457131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b842-bc6c-4cb2-b5cc-956d12b816c9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:36.504026 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b168e3e-6a5b-4d5f-b5d8-2325ddc14a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:36.504635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168e3e-6a5b-4d5f-b5d8-2325ddc14a98 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:36.504923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168e3e-6a5b-4d5f-b5d8-2325ddc14a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:36.505236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168e3e-6a5b-4d5f-b5d8-2325ddc14a98 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:36.505979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b168e3e-6a5b-4d5f-b5d8-2325ddc14a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:36.506293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b168e3e-6a5b-4d5f-b5d8-2325ddc14a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:36.507717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b168e3e-6a5b-4d5f-b5d8-2325ddc14a98 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:36.531844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 342/706] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:36.538236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398fa46-af64-495b-a38f-7c1ce16b77b5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:36.679583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314a45-afaf-46fc-9eea-db16354eb4ee None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:36.679874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314a45-afaf-46fc-9eea-db16354eb4ee None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:36.680152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314a45-afaf-46fc-9eea-db16354eb4ee None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:36.681828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 343/707] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:36.687685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b63571-4dcb-4f5c-84bb-b88f84c1c058 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:36.687972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b63571-4dcb-4f5c-84bb-b88f84c1c058 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:36.688254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b63571-4dcb-4f5c-84bb-b88f84c1c058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:36.691991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398fa46-af64-495b-a38f-7c1ce16b77b5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:36.707486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-34b63571-4dcb-4f5c-84bb-b88f84c1c058 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:36.708671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-34b63571-4dcb-4f5c-84bb-b88f84c1c058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:36.737963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bee268-7e0c-4e59-94b2-9c465ba759a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:36.740555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bee268-7e0c-4e59-94b2-9c465ba759a4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:36.741559 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bee268-7e0c-4e59-94b2-9c465ba759a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:36.742593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bee268-7e0c-4e59-94b2-9c465ba759a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:36.752178 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bee268-7e0c-4e59-94b2-9c465ba759a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:36.753845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bee268-7e0c-4e59-94b2-9c465ba759a4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:36.769249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-63bee268-7e0c-4e59-94b2-9c465ba759a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:36.770970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 365/708] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:36.777381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bee268-7e0c-4e59-94b2-9c465ba759a4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:36.786846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 344/709] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:06:36.808937 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b63571-4dcb-4f5c-84bb-b88f84c1c058 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:36.893887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bee268-7e0c-4e59-94b2-9c465ba759a4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:36.914530 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b63571-4dcb-4f5c-84bb-b88f84c1c058 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:36.929566 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47562c3f-31ba-40c1-9217-b12ece431672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:36.930232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562c3f-31ba-40c1-9217-b12ece431672 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:36.930514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562c3f-31ba-40c1-9217-b12ece431672 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:36.930788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562c3f-31ba-40c1-9217-b12ece431672 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:36.931569 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47562c3f-31ba-40c1-9217-b12ece431672 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:36.931875 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47562c3f-31ba-40c1-9217-b12ece431672 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:36.933392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47562c3f-31ba-40c1-9217-b12ece431672 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:36.946812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 366/710] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:36.952472 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47562c3f-31ba-40c1-9217-b12ece431672 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:36.954810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319da51-724c-40e4-a792-333fcb862e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:36.955847 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319da51-724c-40e4-a792-333fcb862e45 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:36.956312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319da51-724c-40e4-a792-333fcb862e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:36.956782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319da51-724c-40e4-a792-333fcb862e45 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:36.957641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319da51-724c-40e4-a792-333fcb862e45 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:36.959218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319da51-724c-40e4-a792-333fcb862e45 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:36.972881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-3319da51-724c-40e4-a792-333fcb862e45 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 14:06:36.974671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 345/711] 10.222.0.61 () {56 vars in 1129 bytes} [Tue Apr 12 14:06:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:36.983186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319da51-724c-40e4-a792-333fcb862e45 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:37.083778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47562c3f-31ba-40c1-9217-b12ece431672 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:37.153274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcbaee-f3a3-435b-913b-68df4dacf285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:37.154279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcbaee-f3a3-435b-913b-68df4dacf285 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:37.154901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcbaee-f3a3-435b-913b-68df4dacf285 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:37.156573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcbaee-f3a3-435b-913b-68df4dacf285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:37.157647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcbaee-f3a3-435b-913b-68df4dacf285 None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=987dcad83b914b5894955dfe3e1f71ab) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:37.159849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcbaee-f3a3-435b-913b-68df4dacf285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:37.161537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcbaee-f3a3-435b-913b-68df4dacf285 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:37.167820 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319da51-724c-40e4-a792-333fcb862e45 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:37.173339 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 367/712] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:36 2022] GET /identity/v3/role_assignments?user.id=987dcad83b914b5894955dfe3e1f71ab&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:37.221317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b46188-9764-42eb-9eb9-15f9a5a30487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:37.222006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b46188-9764-42eb-9eb9-15f9a5a30487 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:37.222286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b46188-9764-42eb-9eb9-15f9a5a30487 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:37.222561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b46188-9764-42eb-9eb9-15f9a5a30487 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:37.223287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b46188-9764-42eb-9eb9-15f9a5a30487 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:37.223599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b46188-9764-42eb-9eb9-15f9a5a30487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:37.225101 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b46188-9764-42eb-9eb9-15f9a5a30487 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:37.230239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 346/713] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Apr 12 14:06:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:37.235956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcbaee-f3a3-435b-913b-68df4dacf285 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:37.373589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcbaee-f3a3-435b-913b-68df4dacf285 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:37.415611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9676f-a53f-42b8-902b-baad2c21dc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:37.416276 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9676f-a53f-42b8-902b-baad2c21dc4e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:37.416557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9676f-a53f-42b8-902b-baad2c21dc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:37.416827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9676f-a53f-42b8-902b-baad2c21dc4e None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:37.417552 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9676f-a53f-42b8-902b-baad2c21dc4e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:37.417858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9676f-a53f-42b8-902b-baad2c21dc4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:37.419206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9676f-a53f-42b8-902b-baad2c21dc4e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:37.430150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 368/714] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Apr 12 14:06:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:37.573568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e1f4-1b1f-4e55-b915-a2f71245ebba None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:37.574150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e1f4-1b1f-4e55-b915-a2f71245ebba None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:37.574150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e1f4-1b1f-4e55-b915-a2f71245ebba None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:37.575860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 347/715] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:37.582005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385fd3-407b-44eb-8c6c-586a322a3937 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:37.582296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385fd3-407b-44eb-8c6c-586a322a3937 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:37.582576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385fd3-407b-44eb-8c6c-586a322a3937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:37.602059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2c385fd3-407b-44eb-8c6c-586a322a3937 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:37.603661 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2c385fd3-407b-44eb-8c6c-586a322a3937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:37.684383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 369/716] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:06:37.708321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534e1f4-1b1f-4e55-b915-a2f71245ebba None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:37.838162 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534e1f4-1b1f-4e55-b915-a2f71245ebba None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:37.883326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d958cfb-9516-4036-bdfb-f6079a099a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:37.884135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d958cfb-9516-4036-bdfb-f6079a099a5e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:37.884452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d958cfb-9516-4036-bdfb-f6079a099a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:37.884731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d958cfb-9516-4036-bdfb-f6079a099a5e None admin] PATH_INFO: `/v3/services/network` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:37.885417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d958cfb-9516-4036-bdfb-f6079a099a5e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:37.886795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d958cfb-9516-4036-bdfb-f6079a099a5e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:37.902521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-5d958cfb-9516-4036-bdfb-f6079a099a5e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 14:06:37.904019 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 348/717] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:37 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:37.911193 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385fd3-407b-44eb-8c6c-586a322a3937 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:38.071387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385fd3-407b-44eb-8c6c-586a322a3937 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:38.113088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5f594-c853-4c00-bd13-2ef3bd166502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:38.114133 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f594-c853-4c00-bd13-2ef3bd166502 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:38.114637 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f594-c853-4c00-bd13-2ef3bd166502 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:38.115130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f594-c853-4c00-bd13-2ef3bd166502 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:38.116043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5f594-c853-4c00-bd13-2ef3bd166502 None admin] RBAC: Adding query filter params (name=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:38.116570 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5f594-c853-4c00-bd13-2ef3bd166502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:38.118170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5f594-c853-4c00-bd13-2ef3bd166502 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:38.123572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 370/718] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:06:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:38.129706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d958cfb-9516-4036-bdfb-f6079a099a5e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:38.264847 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d958cfb-9516-4036-bdfb-f6079a099a5e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:38.345584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de37d31-557e-4019-989c-e6704fb76e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:38.346527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de37d31-557e-4019-989c-e6704fb76e56 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:38.346813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de37d31-557e-4019-989c-e6704fb76e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:38.347092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de37d31-557e-4019-989c-e6704fb76e56 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:38.347796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de37d31-557e-4019-989c-e6704fb76e56 None admin] RBAC: Adding query filter params (type=network) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:38.348107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de37d31-557e-4019-989c-e6704fb76e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:38.349508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de37d31-557e-4019-989c-e6704fb76e56 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:38.357817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 349/719] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:06:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:39.182862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5d155-a5b9-496a-832e-175b98ac040c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:39.183895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5d155-a5b9-496a-832e-175b98ac040c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:39.184375 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5d155-a5b9-496a-832e-175b98ac040c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:39.186265 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 371/720] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:39.191319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2c4fd-d2ae-4df2-99bb-aaca243ceb76 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:39.192156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2c4fd-d2ae-4df2-99bb-aaca243ceb76 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:39.192636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2c4fd-d2ae-4df2-99bb-aaca243ceb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:39.213404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-34d2c4fd-d2ae-4df2-99bb-aaca243ceb76 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:39.214865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-34d2c4fd-d2ae-4df2-99bb-aaca243ceb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:39.304728 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 350/721] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:39.338838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5d155-a5b9-496a-832e-175b98ac040c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:39.480000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5d155-a5b9-496a-832e-175b98ac040c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:39.525628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca638c-376c-4e72-99a4-99a8b880ad84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:39.526435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca638c-376c-4e72-99a4-99a8b880ad84 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:39.526717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca638c-376c-4e72-99a4-99a8b880ad84 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:39.526993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca638c-376c-4e72-99a4-99a8b880ad84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:39.550014 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca638c-376c-4e72-99a4-99a8b880ad84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:39.556834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-39ca638c-376c-4e72-99a4-99a8b880ad84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:06:39.558388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 372/722] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:39.564629 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2c4fd-d2ae-4df2-99bb-aaca243ceb76 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:39.669013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cfec0-5586-4117-bc0e-3f55b2c36212 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:39.669308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cfec0-5586-4117-bc0e-3f55b2c36212 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:39.669585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cfec0-5586-4117-bc0e-3f55b2c36212 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:39.670953 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 373/723] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:39.679354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77d5b-fff6-438e-ba62-53636967ef9f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:39.679641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77d5b-fff6-438e-ba62-53636967ef9f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:39.679917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77d5b-fff6-438e-ba62-53636967ef9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:39.694434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2c4fd-d2ae-4df2-99bb-aaca243ceb76 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:39.708944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c1f77d5b-fff6-438e-ba62-53636967ef9f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:39.710164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c1f77d5b-fff6-438e-ba62-53636967ef9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:39.729167 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a4e1-acd3-4a93-ada0-57cf6f39546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:39.729842 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a4e1-acd3-4a93-ada0-57cf6f39546c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:39.730176 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a4e1-acd3-4a93-ada0-57cf6f39546c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:39.730399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a4e1-acd3-4a93-ada0-57cf6f39546c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:39.731148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2a4e1-acd3-4a93-ada0-57cf6f39546c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:39.731454 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2a4e1-acd3-4a93-ada0-57cf6f39546c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:39.732828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2a4e1-acd3-4a93-ada0-57cf6f39546c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:39.753202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 351/724] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:39.760212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a4e1-acd3-4a93-ada0-57cf6f39546c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:39.866734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 374/725] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 14:06:39.884782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a4e1-acd3-4a93-ada0-57cf6f39546c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:39.902588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77d5b-fff6-438e-ba62-53636967ef9f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:39.924118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f0c05-459b-478d-a865-889ab7996720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:39.924925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f0c05-459b-478d-a865-889ab7996720 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:39.925231 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f0c05-459b-478d-a865-889ab7996720 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:39.925504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f0c05-459b-478d-a865-889ab7996720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:39.945638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f0c05-459b-478d-a865-889ab7996720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:39.947639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f0c05-459b-478d-a865-889ab7996720 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:39.986676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-942f0c05-459b-478d-a865-889ab7996720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:39.988673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 352/726] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:39.994298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f0c05-459b-478d-a865-889ab7996720 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:40.021741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77d5b-fff6-438e-ba62-53636967ef9f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:40.056533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29886a98-7283-4d0b-a742-f2a47e1e5b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:40.057377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886a98-7283-4d0b-a742-f2a47e1e5b77 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.057661 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886a98-7283-4d0b-a742-f2a47e1e5b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.057938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886a98-7283-4d0b-a742-f2a47e1e5b77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.070224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29886a98-7283-4d0b-a742-f2a47e1e5b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:40.079113 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-29886a98-7283-4d0b-a742-f2a47e1e5b77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:40.079541 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 375/727] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:40.090026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29886a98-7283-4d0b-a742-f2a47e1e5b77 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:40.149676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f0c05-459b-478d-a865-889ab7996720 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:40.184143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64c8bb-048c-4612-96ac-00d209dfeba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:40.184808 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c8bb-048c-4612-96ac-00d209dfeba1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.185123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c8bb-048c-4612-96ac-00d209dfeba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.185400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c8bb-048c-4612-96ac-00d209dfeba1 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.186122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64c8bb-048c-4612-96ac-00d209dfeba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:40.186595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64c8bb-048c-4612-96ac-00d209dfeba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:40.188109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64c8bb-048c-4612-96ac-00d209dfeba1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:40.201107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 353/728] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:40.207626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64c8bb-048c-4612-96ac-00d209dfeba1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:40.261142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29886a98-7283-4d0b-a742-f2a47e1e5b77 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:40.303522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852afa1e-4361-4ecc-9ff1-682335609762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:40.304530 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852afa1e-4361-4ecc-9ff1-682335609762 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.304822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852afa1e-4361-4ecc-9ff1-682335609762 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.305126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852afa1e-4361-4ecc-9ff1-682335609762 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.306144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852afa1e-4361-4ecc-9ff1-682335609762 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:40.306455 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852afa1e-4361-4ecc-9ff1-682335609762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:40.308308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852afa1e-4361-4ecc-9ff1-682335609762 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:40.313771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64c8bb-048c-4612-96ac-00d209dfeba1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:40.324734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 376/729] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:40.326289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987bae9-9e65-4ba1-8643-7e527e9801fb None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.326577 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987bae9-9e65-4ba1-8643-7e527e9801fb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.326849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987bae9-9e65-4ba1-8643-7e527e9801fb None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.331493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 377/730] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:40.332429 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987bae9-9e65-4ba1-8643-7e527e9801fb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:40.357992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a82c4-589e-45d9-a512-d2e0f38a54c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:40.359131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a82c4-589e-45d9-a512-d2e0f38a54c2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.359610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a82c4-589e-45d9-a512-d2e0f38a54c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.360054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a82c4-589e-45d9-a512-d2e0f38a54c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.368860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a82c4-589e-45d9-a512-d2e0f38a54c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:40.370655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a82c4-589e-45d9-a512-d2e0f38a54c2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:40.385558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-c90a82c4-589e-45d9-a512-d2e0f38a54c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 14:06:40.391721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 354/731] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Apr 12 14:06:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:40.393532 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f1807-2750-4fcc-9f52-2c778829af7e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.394073 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f1807-2750-4fcc-9f52-2c778829af7e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.394527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f1807-2750-4fcc-9f52-2c778829af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.412314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1c8f1807-2750-4fcc-9f52-2c778829af7e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:40.413831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1c8f1807-2750-4fcc-9f52-2c778829af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:40.459803 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987bae9-9e65-4ba1-8643-7e527e9801fb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:40.493066 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 355/732] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:40.493066 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f1807-2750-4fcc-9f52-2c778829af7e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:40.507589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459f6f7-33fd-4ff4-824e-30a5f6907287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:40.508730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459f6f7-33fd-4ff4-824e-30a5f6907287 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.509256 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459f6f7-33fd-4ff4-824e-30a5f6907287 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.509778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459f6f7-33fd-4ff4-824e-30a5f6907287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.522514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459f6f7-33fd-4ff4-824e-30a5f6907287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:40.523903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459f6f7-33fd-4ff4-824e-30a5f6907287 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:40.541063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-f459f6f7-33fd-4ff4-824e-30a5f6907287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:40.542304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 378/733] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:40.543532 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df896fd-9c66-434f-9bd1-f3d1dcc9c5c7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.543818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df896fd-9c66-434f-9bd1-f3d1dcc9c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.544098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df896fd-9c66-434f-9bd1-f3d1dcc9c5c7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.549146 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 379/734] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:40.550680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df896fd-9c66-434f-9bd1-f3d1dcc9c5c7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:40.600475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f1807-2750-4fcc-9f52-2c778829af7e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:40.634768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623534c-07e2-464d-a8c6-a7e79e00042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:40.635469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623534c-07e2-464d-a8c6-a7e79e00042d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.635720 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623534c-07e2-464d-a8c6-a7e79e00042d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.635987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623534c-07e2-464d-a8c6-a7e79e00042d None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.636841 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623534c-07e2-464d-a8c6-a7e79e00042d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:40.637182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623534c-07e2-464d-a8c6-a7e79e00042d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:40.639631 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623534c-07e2-464d-a8c6-a7e79e00042d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:40.656283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df896fd-9c66-434f-9bd1-f3d1dcc9c5c7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:40.671378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 356/735] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Apr 12 14:06:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:40.671378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623534c-07e2-464d-a8c6-a7e79e00042d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:40.697945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3ba2b-c117-4972-81f3-343686f423c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:40.698746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ba2b-c117-4972-81f3-343686f423c7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.699025 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ba2b-c117-4972-81f3-343686f423c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.699312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ba2b-c117-4972-81f3-343686f423c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.710144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3ba2b-c117-4972-81f3-343686f423c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:40.717377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-68d3ba2b-c117-4972-81f3-343686f423c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:06:40.724174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 380/736] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:40.725559 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61515b-7a13-4fb8-9f80-fbc4010ac825 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.725861 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61515b-7a13-4fb8-9f80-fbc4010ac825 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.726137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61515b-7a13-4fb8-9f80-fbc4010ac825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.743720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-dc61515b-7a13-4fb8-9f80-fbc4010ac825 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:40.744907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dc61515b-7a13-4fb8-9f80-fbc4010ac825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:40.780592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623534c-07e2-464d-a8c6-a7e79e00042d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:40.815494 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e59736-9445-49f9-9b94-87c3f1c40dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:40.816567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e59736-9445-49f9-9b94-87c3f1c40dba None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.816567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e59736-9445-49f9-9b94-87c3f1c40dba None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.817035 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e59736-9445-49f9-9b94-87c3f1c40dba None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.818302 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e59736-9445-49f9-9b94-87c3f1c40dba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:40.818302 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e59736-9445-49f9-9b94-87c3f1c40dba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:40.819804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e59736-9445-49f9-9b94-87c3f1c40dba None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:40.831755 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 357/737] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:40.832915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e59736-9445-49f9-9b94-87c3f1c40dba None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:40.848991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 381/738] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:40.848991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61515b-7a13-4fb8-9f80-fbc4010ac825 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:40.943601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e59736-9445-49f9-9b94-87c3f1c40dba None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:40.963434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61515b-7a13-4fb8-9f80-fbc4010ac825 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:40.979876 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5149d9-3826-4492-96d3-4346efdbbc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:40.980714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5149d9-3826-4492-96d3-4346efdbbc65 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:40.981024 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5149d9-3826-4492-96d3-4346efdbbc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:40.981307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5149d9-3826-4492-96d3-4346efdbbc65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:40.993398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5149d9-3826-4492-96d3-4346efdbbc65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:40.994901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5149d9-3826-4492-96d3-4346efdbbc65 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:41.003049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd1e1-e945-4121-ae37-c2c47c0904b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:41.003942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd1e1-e945-4121-ae37-c2c47c0904b2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.004219 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd1e1-e945-4121-ae37-c2c47c0904b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.004487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd1e1-e945-4121-ae37-c2c47c0904b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.005266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cd1e1-e945-4121-ae37-c2c47c0904b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:41.005572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cd1e1-e945-4121-ae37-c2c47c0904b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:41.006920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cd1e1-e945-4121-ae37-c2c47c0904b2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:41.011483 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-ad5149d9-3826-4492-96d3-4346efdbbc65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:41.017522 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 358/739] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:41.017522 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5149d9-3826-4492-96d3-4346efdbbc65 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:41.020999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 382/740] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:41.020999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd1e1-e945-4121-ae37-c2c47c0904b2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:41.121093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5149d9-3826-4492-96d3-4346efdbbc65 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:41.121340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd1e1-e945-4121-ae37-c2c47c0904b2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:41.154901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c4ad9-0595-4ff8-b29e-73080e58944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:41.155561 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4ad9-0595-4ff8-b29e-73080e58944f None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.155964 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4ad9-0595-4ff8-b29e-73080e58944f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.156117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4ad9-0595-4ff8-b29e-73080e58944f None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.156807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c4ad9-0595-4ff8-b29e-73080e58944f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:41.158810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c4ad9-0595-4ff8-b29e-73080e58944f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:41.160175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4280c3-b43f-4ef0-94e7-dd5be0b685c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:41.161429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4280c3-b43f-4ef0-94e7-dd5be0b685c3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.161718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4280c3-b43f-4ef0-94e7-dd5be0b685c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.161996 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4280c3-b43f-4ef0-94e7-dd5be0b685c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.170136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4280c3-b43f-4ef0-94e7-dd5be0b685c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:41.171568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4280c3-b43f-4ef0-94e7-dd5be0b685c3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:41.185755 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-8b4280c3-b43f-4ef0-94e7-dd5be0b685c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 14:06:41.187068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 359/741] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Apr 12 14:06:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:41.189379 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4280c3-b43f-4ef0-94e7-dd5be0b685c3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:41.254267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 383/742] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:06:41 2022] POST /identity/v3/services => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:41.255318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c4ad9-0595-4ff8-b29e-73080e58944f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:41.304922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4280c3-b43f-4ef0-94e7-dd5be0b685c3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:41.349610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a35ad-a11b-4371-950a-60282c7e0087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:41.350282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a35ad-a11b-4371-950a-60282c7e0087 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.350558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a35ad-a11b-4371-950a-60282c7e0087 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.350830 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a35ad-a11b-4371-950a-60282c7e0087 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.351555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a35ad-a11b-4371-950a-60282c7e0087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:41.351849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a35ad-a11b-4371-950a-60282c7e0087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:41.353267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a35ad-a11b-4371-950a-60282c7e0087 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:41.366557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 360/743] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:41.367966 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a35ad-a11b-4371-950a-60282c7e0087 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:41.374403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c4ad9-0595-4ff8-b29e-73080e58944f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:41.409623 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f73dc-8990-4832-970e-4d45e212b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:41.410432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f73dc-8990-4832-970e-4d45e212b74b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.410713 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f73dc-8990-4832-970e-4d45e212b74b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.410984 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f73dc-8990-4832-970e-4d45e212b74b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.424363 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f73dc-8990-4832-970e-4d45e212b74b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:41.426001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f73dc-8990-4832-970e-4d45e212b74b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:41.444676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-ef1f73dc-8990-4832-970e-4d45e212b74b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:41.445128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 384/744] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:41.446611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a4375-0321-4e6d-81b5-af9d3f48d260 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.446896 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a4375-0321-4e6d-81b5-af9d3f48d260 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.447167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a4375-0321-4e6d-81b5-af9d3f48d260 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.452377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 385/745] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:41.453149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a4375-0321-4e6d-81b5-af9d3f48d260 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:41.483486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a35ad-a11b-4371-950a-60282c7e0087 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:41.516732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b9f86-49ac-43be-b0e8-11ace34c1a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:41.517950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b9f86-49ac-43be-b0e8-11ace34c1a76 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.518304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b9f86-49ac-43be-b0e8-11ace34c1a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.518605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b9f86-49ac-43be-b0e8-11ace34c1a76 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.519437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b9f86-49ac-43be-b0e8-11ace34c1a76 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:41.519748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b9f86-49ac-43be-b0e8-11ace34c1a76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:41.521226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b9f86-49ac-43be-b0e8-11ace34c1a76 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:41.542846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 361/746] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Apr 12 14:06:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:41.542846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b9f86-49ac-43be-b0e8-11ace34c1a76 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:41.564494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a4375-0321-4e6d-81b5-af9d3f48d260 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:41.597242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba790a75-f6c9-49be-9445-d1d4bb863c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:41.598040 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba790a75-f6c9-49be-9445-d1d4bb863c44 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.598321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba790a75-f6c9-49be-9445-d1d4bb863c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.598593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba790a75-f6c9-49be-9445-d1d4bb863c44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.605179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba790a75-f6c9-49be-9445-d1d4bb863c44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:41.606629 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba790a75-f6c9-49be-9445-d1d4bb863c44 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:41.622719 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-ba790a75-f6c9-49be-9445-d1d4bb863c44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:41.629160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 386/747] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:41.629160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e1fb3-4d1e-49a4-946d-b88098a07ca4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.629160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e1fb3-4d1e-49a4-946d-b88098a07ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.629160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e1fb3-4d1e-49a4-946d-b88098a07ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.641339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b9f86-49ac-43be-b0e8-11ace34c1a76 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:41.644038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c81e1fb3-4d1e-49a4-946d-b88098a07ca4 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:41.645271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c81e1fb3-4d1e-49a4-946d-b88098a07ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:41.683972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274188e4-26ff-4973-b7be-95dbbaa82ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:41.684638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274188e4-26ff-4973-b7be-95dbbaa82ccd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.684918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274188e4-26ff-4973-b7be-95dbbaa82ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.685225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274188e4-26ff-4973-b7be-95dbbaa82ccd None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.685947 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274188e4-26ff-4973-b7be-95dbbaa82ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:41.686340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274188e4-26ff-4973-b7be-95dbbaa82ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:41.687758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274188e4-26ff-4973-b7be-95dbbaa82ccd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:41.699317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 362/748] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:41.700137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274188e4-26ff-4973-b7be-95dbbaa82ccd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:41.725224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 387/749] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 14:06:41.737895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e1fb3-4d1e-49a4-946d-b88098a07ca4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:41.796457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274188e4-26ff-4973-b7be-95dbbaa82ccd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:41.829573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fba419-9013-4ef2-b381-68d4b26c26c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:41.830634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fba419-9013-4ef2-b381-68d4b26c26c8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.831065 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fba419-9013-4ef2-b381-68d4b26c26c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.831520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fba419-9013-4ef2-b381-68d4b26c26c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.836213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e1fb3-4d1e-49a4-946d-b88098a07ca4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:41.869599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd479e5-8ab4-4672-aa35-787a2ab58136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:41.870253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd479e5-8ab4-4672-aa35-787a2ab58136 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:41.870534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd479e5-8ab4-4672-aa35-787a2ab58136 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:41.870806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd479e5-8ab4-4672-aa35-787a2ab58136 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:41.871584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd479e5-8ab4-4672-aa35-787a2ab58136 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:41.871894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd479e5-8ab4-4672-aa35-787a2ab58136 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:41.873340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd479e5-8ab4-4672-aa35-787a2ab58136 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:41.889658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 388/750] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:41.889658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd479e5-8ab4-4672-aa35-787a2ab58136 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:41.905700 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fba419-9013-4ef2-b381-68d4b26c26c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:41.907141 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fba419-9013-4ef2-b381-68d4b26c26c8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:41.997482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd479e5-8ab4-4672-aa35-787a2ab58136 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:42.008290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 363/751] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:41 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 14:06:42.008290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fba419-9013-4ef2-b381-68d4b26c26c8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:42.034202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757a699-a420-4a41-b22c-812dabdf710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:42.035001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757a699-a420-4a41-b22c-812dabdf710a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:42.035282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757a699-a420-4a41-b22c-812dabdf710a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:42.035556 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757a699-a420-4a41-b22c-812dabdf710a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:42.043080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757a699-a420-4a41-b22c-812dabdf710a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:42.044505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757a699-a420-4a41-b22c-812dabdf710a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:42.057699 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-8757a699-a420-4a41-b22c-812dabdf710a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 14:06:42.063369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 389/752] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:42.063369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757a699-a420-4a41-b22c-812dabdf710a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:42.106269 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fba419-9013-4ef2-b381-68d4b26c26c8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:42.144756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778e8cb-8525-4d96-a13c-7068410fac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:42.145373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778e8cb-8525-4d96-a13c-7068410fac7b None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:42.145660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778e8cb-8525-4d96-a13c-7068410fac7b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:42.145938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778e8cb-8525-4d96-a13c-7068410fac7b None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:42.146759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778e8cb-8525-4d96-a13c-7068410fac7b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:42.148026 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778e8cb-8525-4d96-a13c-7068410fac7b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:42.162897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757a699-a420-4a41-b22c-812dabdf710a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:42.195528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01eccf-fe3c-4ec7-97c3-202db8c3b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:42.196687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01eccf-fe3c-4ec7-97c3-202db8c3b001 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:42.197010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01eccf-fe3c-4ec7-97c3-202db8c3b001 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:42.197266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01eccf-fe3c-4ec7-97c3-202db8c3b001 None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/b9933c6dc8f74cd59f6a1f8c11abf652/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:42.199189 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01eccf-fe3c-4ec7-97c3-202db8c3b001 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=b9933c6dc8f74cd59f6a1f8c11abf652, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:42.200608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01eccf-fe3c-4ec7-97c3-202db8c3b001 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:42.248514 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 364/753] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:06:42 2022] POST /identity/v3/services => generated 240 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:42.249381 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778e8cb-8525-4d96-a13c-7068410fac7b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:42.309567 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 390/754] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:06:42 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/b9933c6dc8f74cd59f6a1f8c11abf652/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:06:42.310944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01eccf-fe3c-4ec7-97c3-202db8c3b001 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:42.372796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778e8cb-8525-4d96-a13c-7068410fac7b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:42.413634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efe284-6ac4-4587-84ca-ecdbc4adcb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:42.414468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efe284-6ac4-4587-84ca-ecdbc4adcb6f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:42.414751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efe284-6ac4-4587-84ca-ecdbc4adcb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:42.415034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efe284-6ac4-4587-84ca-ecdbc4adcb6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:42.428690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efe284-6ac4-4587-84ca-ecdbc4adcb6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:42.429704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efe284-6ac4-4587-84ca-ecdbc4adcb6f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:42.448288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-74efe284-6ac4-4587-84ca-ecdbc4adcb6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:42.454285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 365/755] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:42.456411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efe284-6ac4-4587-84ca-ecdbc4adcb6f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:42.489834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01eccf-fe3c-4ec7-97c3-202db8c3b001 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:42.527899 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e2d5f-c52a-4c3d-90db-a38c78d11fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:42.529001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e2d5f-c52a-4c3d-90db-a38c78d11fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:42.529509 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e2d5f-c52a-4c3d-90db-a38c78d11fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:42.529982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e2d5f-c52a-4c3d-90db-a38c78d11fe2 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:42.531018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e2d5f-c52a-4c3d-90db-a38c78d11fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:42.531541 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e2d5f-c52a-4c3d-90db-a38c78d11fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:42.533947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e2d5f-c52a-4c3d-90db-a38c78d11fe2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:42.555653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 391/756] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Apr 12 14:06:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:42.560813 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e2d5f-c52a-4c3d-90db-a38c78d11fe2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:42.566117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efe284-6ac4-4587-84ca-ecdbc4adcb6f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:42.603675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09c1f3-b9a5-415f-88c9-70485566dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:42.604348 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09c1f3-b9a5-415f-88c9-70485566dc30 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:42.604635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09c1f3-b9a5-415f-88c9-70485566dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:42.604915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09c1f3-b9a5-415f-88c9-70485566dc30 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:42.605684 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09c1f3-b9a5-415f-88c9-70485566dc30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:42.605996 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09c1f3-b9a5-415f-88c9-70485566dc30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:42.607375 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09c1f3-b9a5-415f-88c9-70485566dc30 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:42.621333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 366/757] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:42.627148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09c1f3-b9a5-415f-88c9-70485566dc30 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:42.675471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e2d5f-c52a-4c3d-90db-a38c78d11fe2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:42.746330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06779b7-f4bb-4e52-92dd-cb4ae2933c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:42.746989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06779b7-f4bb-4e52-92dd-cb4ae2933c0e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:42.747271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06779b7-f4bb-4e52-92dd-cb4ae2933c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:42.747543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06779b7-f4bb-4e52-92dd-cb4ae2933c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:42.791725 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09c1f3-b9a5-415f-88c9-70485566dc30 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:42.835815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58a3d1-6158-4324-96a5-42d79dd6f6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:42.836625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58a3d1-6158-4324-96a5-42d79dd6f6fb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:42.836908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58a3d1-6158-4324-96a5-42d79dd6f6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:42.837206 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58a3d1-6158-4324-96a5-42d79dd6f6fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:42.856928 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58a3d1-6158-4324-96a5-42d79dd6f6fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:42.858435 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58a3d1-6158-4324-96a5-42d79dd6f6fb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:42.878455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-4e58a3d1-6158-4324-96a5-42d79dd6f6fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:42.885305 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 367/758] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:42.886232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58a3d1-6158-4324-96a5-42d79dd6f6fb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:42.902892 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06779b7-f4bb-4e52-92dd-cb4ae2933c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:42.904369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06779b7-f4bb-4e52-92dd-cb4ae2933c0e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:43.006233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 392/759] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:06:43.011577 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06779b7-f4bb-4e52-92dd-cb4ae2933c0e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:43.114884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06779b7-f4bb-4e52-92dd-cb4ae2933c0e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:43.132521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58a3d1-6158-4324-96a5-42d79dd6f6fb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:43.151148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057e3bf-9459-4e8d-990e-156ee1930c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:43.151967 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057e3bf-9459-4e8d-990e-156ee1930c86 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:43.152257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057e3bf-9459-4e8d-990e-156ee1930c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:43.152536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057e3bf-9459-4e8d-990e-156ee1930c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:43.163762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057e3bf-9459-4e8d-990e-156ee1930c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:43.165245 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057e3bf-9459-4e8d-990e-156ee1930c86 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:43.182229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-a057e3bf-9459-4e8d-990e-156ee1930c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:43.183857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 393/760] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:43.189383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057e3bf-9459-4e8d-990e-156ee1930c86 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:43.206040 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5b47-0233-46a5-80c0-c94a0ce4249c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:43.207193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5b47-0233-46a5-80c0-c94a0ce4249c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:43.207682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5b47-0233-46a5-80c0-c94a0ce4249c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:43.208157 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5b47-0233-46a5-80c0-c94a0ce4249c None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:43.209193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe5b47-0233-46a5-80c0-c94a0ce4249c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:43.209727 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe5b47-0233-46a5-80c0-c94a0ce4249c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:43.211422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe5b47-0233-46a5-80c0-c94a0ce4249c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:43.236287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 368/761] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:43.242445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5b47-0233-46a5-80c0-c94a0ce4249c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:43.298845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057e3bf-9459-4e8d-990e-156ee1930c86 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:43.334439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee379f99-6206-45a0-b8be-0b9c9a0a0f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:43.335134 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee379f99-6206-45a0-b8be-0b9c9a0a0f47 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:43.335421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee379f99-6206-45a0-b8be-0b9c9a0a0f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:43.335702 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee379f99-6206-45a0-b8be-0b9c9a0a0f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:43.336448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee379f99-6206-45a0-b8be-0b9c9a0a0f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:43.336762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee379f99-6206-45a0-b8be-0b9c9a0a0f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:43.338229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee379f99-6206-45a0-b8be-0b9c9a0a0f47 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:43.353003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 394/762] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:43.357998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee379f99-6206-45a0-b8be-0b9c9a0a0f47 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:43.438647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5b47-0233-46a5-80c0-c94a0ce4249c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:43.461469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee379f99-6206-45a0-b8be-0b9c9a0a0f47 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:43.496142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b367e2-cd68-4f07-ba5d-c86e3619e311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:43.496941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b367e2-cd68-4f07-ba5d-c86e3619e311 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:43.497269 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b367e2-cd68-4f07-ba5d-c86e3619e311 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:43.497527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b367e2-cd68-4f07-ba5d-c86e3619e311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:43.498244 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883925f7-c461-4ad8-a3d4-ec9fa3ad58b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:43.499160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883925f7-c461-4ad8-a3d4-ec9fa3ad58b3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:43.499640 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883925f7-c461-4ad8-a3d4-ec9fa3ad58b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:43.500112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883925f7-c461-4ad8-a3d4-ec9fa3ad58b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:43.501208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883925f7-c461-4ad8-a3d4-ec9fa3ad58b3 None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=e84a4f86f4c54625a22cfdcbc08da73b) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:43.501761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883925f7-c461-4ad8-a3d4-ec9fa3ad58b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:43.503508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883925f7-c461-4ad8-a3d4-ec9fa3ad58b3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:43.504716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b367e2-cd68-4f07-ba5d-c86e3619e311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:43.513025 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b367e2-cd68-4f07-ba5d-c86e3619e311 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:43.518641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 369/763] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:43 2022] GET /identity/v3/role_assignments?user.id=e84a4f86f4c54625a22cfdcbc08da73b&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:43.519588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-c5b367e2-cd68-4f07-ba5d-c86e3619e311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:43.525816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 395/764] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:43.527006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883925f7-c461-4ad8-a3d4-ec9fa3ad58b3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:43.658851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883925f7-c461-4ad8-a3d4-ec9fa3ad58b3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:43.711017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4700a1-f0f7-450a-912a-fcfc5deb9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:43.711943 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4700a1-f0f7-450a-912a-fcfc5deb9c24 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:43.712378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4700a1-f0f7-450a-912a-fcfc5deb9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:43.712796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4700a1-f0f7-450a-912a-fcfc5deb9c24 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:43.713756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4700a1-f0f7-450a-912a-fcfc5deb9c24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:43.714235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4700a1-f0f7-450a-912a-fcfc5deb9c24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:43.715891 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4700a1-f0f7-450a-912a-fcfc5deb9c24 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:43.734009 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 370/765] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:43.737263 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567ceba-6acb-4dad-9e27-593d6c5a5536 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:43.737551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567ceba-6acb-4dad-9e27-593d6c5a5536 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:43.737829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567ceba-6acb-4dad-9e27-593d6c5a5536 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:43.739491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 396/766] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:43.741137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4700a1-f0f7-450a-912a-fcfc5deb9c24 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:43.744819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04126a3d-c058-4edc-9982-62d8384658d2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:43.746004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04126a3d-c058-4edc-9982-62d8384658d2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:43.746004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04126a3d-c058-4edc-9982-62d8384658d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:43.794122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-04126a3d-c058-4edc-9982-62d8384658d2 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:43.795329 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-04126a3d-c058-4edc-9982-62d8384658d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:43.854869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4700a1-f0f7-450a-912a-fcfc5deb9c24 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:43.899764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94796f-0fc9-464b-8b7b-393ae3df5197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:43.900635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94796f-0fc9-464b-8b7b-393ae3df5197 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:43.901042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94796f-0fc9-464b-8b7b-393ae3df5197 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:43.901419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94796f-0fc9-464b-8b7b-393ae3df5197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:43.902370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94796f-0fc9-464b-8b7b-393ae3df5197 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=987dcad83b914b5894955dfe3e1f71ab) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:43.902782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94796f-0fc9-464b-8b7b-393ae3df5197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:43.904362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94796f-0fc9-464b-8b7b-393ae3df5197 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:43.911970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 371/767] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:43 2022] GET /identity/v3/role_assignments?user.id=987dcad83b914b5894955dfe3e1f71ab&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:43.956036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 397/768] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:06:43.980647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94796f-0fc9-464b-8b7b-393ae3df5197 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:44.138217 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94796f-0fc9-464b-8b7b-393ae3df5197 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:44.196755 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aec9b1-192e-4b3c-84b5-c1bb2f609f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:44.197535 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aec9b1-192e-4b3c-84b5-c1bb2f609f02 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:44.197816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aec9b1-192e-4b3c-84b5-c1bb2f609f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:44.198090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aec9b1-192e-4b3c-84b5-c1bb2f609f02 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:44.198760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aec9b1-192e-4b3c-84b5-c1bb2f609f02 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:44.200156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aec9b1-192e-4b3c-84b5-c1bb2f609f02 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:44.217103 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-b2aec9b1-192e-4b3c-84b5-c1bb2f609f02 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 14:06:44.219762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 372/769] 10.222.0.61 () {56 vars in 1129 bytes} [Tue Apr 12 14:06:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:44.225626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04126a3d-c058-4edc-9982-62d8384658d2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:44.335655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04126a3d-c058-4edc-9982-62d8384658d2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:44.386678 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead05977-7f43-4087-bd25-21b85c54cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:44.387360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05977-7f43-4087-bd25-21b85c54cdea None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:44.387642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05977-7f43-4087-bd25-21b85c54cdea None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:44.387915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05977-7f43-4087-bd25-21b85c54cdea None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:44.388628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead05977-7f43-4087-bd25-21b85c54cdea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:44.388935 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead05977-7f43-4087-bd25-21b85c54cdea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:44.390327 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead05977-7f43-4087-bd25-21b85c54cdea None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:44.395601 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 398/770] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Apr 12 14:06:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:44.401335 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aec9b1-192e-4b3c-84b5-c1bb2f609f02 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:44.526869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aec9b1-192e-4b3c-84b5-c1bb2f609f02 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:44.573326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d7111-5b2a-4a6a-99d5-47cad0cf17f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:44.574063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d7111-5b2a-4a6a-99d5-47cad0cf17f7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:44.574348 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d7111-5b2a-4a6a-99d5-47cad0cf17f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:44.574625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d7111-5b2a-4a6a-99d5-47cad0cf17f7 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:44.575438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d7111-5b2a-4a6a-99d5-47cad0cf17f7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:44.575749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d7111-5b2a-4a6a-99d5-47cad0cf17f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:44.577150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d7111-5b2a-4a6a-99d5-47cad0cf17f7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:44.584860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 373/771] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Apr 12 14:06:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:44.590583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead05977-7f43-4087-bd25-21b85c54cdea None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:44.696227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead05977-7f43-4087-bd25-21b85c54cdea None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:44.742884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae17c9-efec-400d-a831-6f25332e8fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:44.743574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae17c9-efec-400d-a831-6f25332e8fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:44.743921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae17c9-efec-400d-a831-6f25332e8fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:44.744206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae17c9-efec-400d-a831-6f25332e8fc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:44.745076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae17c9-efec-400d-a831-6f25332e8fc3 None admin] RBAC: Adding query filter params (interface=public, service_id=0e168d33d765426abf51a63bf78a8868, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:44.745394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae17c9-efec-400d-a831-6f25332e8fc3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:44.746763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae17c9-efec-400d-a831-6f25332e8fc3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:44.757003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 399/772] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Apr 12 14:06:44 2022] GET /identity/v3/endpoints?service_id=0e168d33d765426abf51a63bf78a8868&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:44.762134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d7111-5b2a-4a6a-99d5-47cad0cf17f7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:44.884592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d7111-5b2a-4a6a-99d5-47cad0cf17f7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:44.936874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132012b-4ec1-423a-84bf-1a3d89074a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:44.937634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132012b-4ec1-423a-84bf-1a3d89074a17 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:44.937925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132012b-4ec1-423a-84bf-1a3d89074a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:44.938200 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132012b-4ec1-423a-84bf-1a3d89074a17 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:44.939603 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132012b-4ec1-423a-84bf-1a3d89074a17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:44.940999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132012b-4ec1-423a-84bf-1a3d89074a17 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:44.947265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 374/773] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Apr 12 14:06:44 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:45.193301 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2841d5-d257-48a3-8c6b-dce6940425c2 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:45.193675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2841d5-d257-48a3-8c6b-dce6940425c2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:45.193921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2841d5-d257-48a3-8c6b-dce6940425c2 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:45.195951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 400/774] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:45.201676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ab35-daac-4da1-9362-7a174bcfaab7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:45.201970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ab35-daac-4da1-9362-7a174bcfaab7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:45.202244 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ab35-daac-4da1-9362-7a174bcfaab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:45.222479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3f04ab35-daac-4da1-9362-7a174bcfaab7 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:45.223704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3f04ab35-daac-4da1-9362-7a174bcfaab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:45.301208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 375/775] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:45.324458 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2841d5-d257-48a3-8c6b-dce6940425c2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:45.430978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2841d5-d257-48a3-8c6b-dce6940425c2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:45.467130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd75c33-4ecc-4c79-908a-430380edbd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:45.467858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd75c33-4ecc-4c79-908a-430380edbd03 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:45.468143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd75c33-4ecc-4c79-908a-430380edbd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:45.468423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd75c33-4ecc-4c79-908a-430380edbd03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:45.480633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd75c33-4ecc-4c79-908a-430380edbd03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:45.488012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-afd75c33-4ecc-4c79-908a-430380edbd03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:06:45.489631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 401/776] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:45.495641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ab35-daac-4da1-9362-7a174bcfaab7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:45.607757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ab35-daac-4da1-9362-7a174bcfaab7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:45.655025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299a0d6-5f5d-4e8a-9c83-a1394455380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:45.655706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299a0d6-5f5d-4e8a-9c83-a1394455380e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:45.655985 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299a0d6-5f5d-4e8a-9c83-a1394455380e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:45.656258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299a0d6-5f5d-4e8a-9c83-a1394455380e None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:45.657102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299a0d6-5f5d-4e8a-9c83-a1394455380e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:45.657523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299a0d6-5f5d-4e8a-9c83-a1394455380e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:45.658910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299a0d6-5f5d-4e8a-9c83-a1394455380e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:45.681418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 376/777] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:45.687185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd75c33-4ecc-4c79-908a-430380edbd03 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:45.739718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c02bce-2ed8-4c61-8f02-5fe60a5221c9 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:45.740314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c02bce-2ed8-4c61-8f02-5fe60a5221c9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:45.740988 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c02bce-2ed8-4c61-8f02-5fe60a5221c9 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:45.743100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 377/778] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:45.749304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb32c5-8185-4c63-b381-689158df25d6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:45.749596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb32c5-8185-4c63-b381-689158df25d6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:45.749878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb32c5-8185-4c63-b381-689158df25d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:45.785059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bcdb32c5-8185-4c63-b381-689158df25d6 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:45.786259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bcdb32c5-8185-4c63-b381-689158df25d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:45.832284 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd75c33-4ecc-4c79-908a-430380edbd03 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:45.859105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 378/779] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:45.884615 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb32c5-8185-4c63-b381-689158df25d6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:45.901695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c51bd-ea60-4816-9963-89aa87089bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:45.902506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c51bd-ea60-4816-9963-89aa87089bac None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:45.902792 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c51bd-ea60-4816-9963-89aa87089bac None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:45.903064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c51bd-ea60-4816-9963-89aa87089bac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:45.923404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c51bd-ea60-4816-9963-89aa87089bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:45.924866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c51bd-ea60-4816-9963-89aa87089bac None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:45.949489 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-db4c51bd-ea60-4816-9963-89aa87089bac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:45.957345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 402/780] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:45.958211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c51bd-ea60-4816-9963-89aa87089bac None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:45.984408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb32c5-8185-4c63-b381-689158df25d6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:46.019591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79593306-e75a-4a62-b9e3-48e15a2798e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:46.020326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79593306-e75a-4a62-b9e3-48e15a2798e6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.020635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79593306-e75a-4a62-b9e3-48e15a2798e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.020882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79593306-e75a-4a62-b9e3-48e15a2798e6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.021581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79593306-e75a-4a62-b9e3-48e15a2798e6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:46.022963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79593306-e75a-4a62-b9e3-48e15a2798e6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:46.034846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-79593306-e75a-4a62-b9e3-48e15a2798e6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 14:06:46.036355 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 379/781] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:45 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:46.041922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79593306-e75a-4a62-b9e3-48e15a2798e6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:46.147257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79593306-e75a-4a62-b9e3-48e15a2798e6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:46.171628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c51bd-ea60-4816-9963-89aa87089bac None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:46.191632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc96ca-1399-498a-a300-9554e5391738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:46.192302 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc96ca-1399-498a-a300-9554e5391738 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.192586 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc96ca-1399-498a-a300-9554e5391738 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.192861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc96ca-1399-498a-a300-9554e5391738 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.193596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc96ca-1399-498a-a300-9554e5391738 None admin] RBAC: Adding query filter params (name=network) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:46.193905 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc96ca-1399-498a-a300-9554e5391738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:46.195284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc96ca-1399-498a-a300-9554e5391738 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:46.203999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 380/782] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:06:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:46.210356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc96ca-1399-498a-a300-9554e5391738 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:46.253636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf382e7-76d7-4c01-bb2a-7a30a3958741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:46.254312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf382e7-76d7-4c01-bb2a-7a30a3958741 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.254598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf382e7-76d7-4c01-bb2a-7a30a3958741 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.254872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf382e7-76d7-4c01-bb2a-7a30a3958741 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.255602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf382e7-76d7-4c01-bb2a-7a30a3958741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:46.255913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf382e7-76d7-4c01-bb2a-7a30a3958741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:46.257362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf382e7-76d7-4c01-bb2a-7a30a3958741 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:46.272019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 403/783] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:46.277394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf382e7-76d7-4c01-bb2a-7a30a3958741 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:46.357147 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc96ca-1399-498a-a300-9554e5391738 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:46.392634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6233a9-2ce2-4e06-b70d-e4b993945d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:46.393340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6233a9-2ce2-4e06-b70d-e4b993945d3f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.393623 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6233a9-2ce2-4e06-b70d-e4b993945d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.393901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6233a9-2ce2-4e06-b70d-e4b993945d3f None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.394625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6233a9-2ce2-4e06-b70d-e4b993945d3f None admin] RBAC: Adding query filter params (type=network) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:46.394925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6233a9-2ce2-4e06-b70d-e4b993945d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:46.396305 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6233a9-2ce2-4e06-b70d-e4b993945d3f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:46.401636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 381/784] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:06:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:46.407233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6233a9-2ce2-4e06-b70d-e4b993945d3f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:46.458708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf382e7-76d7-4c01-bb2a-7a30a3958741 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:46.510887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e178f-2148-4153-90ee-0f724cf926ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:46.511715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e178f-2148-4153-90ee-0f724cf926ca None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.512001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e178f-2148-4153-90ee-0f724cf926ca None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.512279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e178f-2148-4153-90ee-0f724cf926ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.512450 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6233a9-2ce2-4e06-b70d-e4b993945d3f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:46.523215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e178f-2148-4153-90ee-0f724cf926ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:46.524502 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e178f-2148-4153-90ee-0f724cf926ca None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:46.542148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-d42e178f-2148-4153-90ee-0f724cf926ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 14:06:46.542148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 404/785] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Apr 12 14:06:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:46.542543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf19c7-4a04-4c33-8c82-9a4714d6de87 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.542829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf19c7-4a04-4c33-8c82-9a4714d6de87 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.543102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf19c7-4a04-4c33-8c82-9a4714d6de87 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.544620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 405/786] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:46.546653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf19c7-4a04-4c33-8c82-9a4714d6de87 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:46.553102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b53c02-4a01-4198-a6e7-501041800091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:46.553849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53c02-4a01-4198-a6e7-501041800091 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.554203 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53c02-4a01-4198-a6e7-501041800091 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.554545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53c02-4a01-4198-a6e7-501041800091 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.555406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b53c02-4a01-4198-a6e7-501041800091 None admin] RBAC: Adding query filter params (interface=public, service_id=75f5f56cc6b74dac8b42c4f3a8d03dc3, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:46.555784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b53c02-4a01-4198-a6e7-501041800091 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:46.557304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b53c02-4a01-4198-a6e7-501041800091 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:46.565814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 382/787] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Apr 12 14:06:46 2022] GET /identity/v3/endpoints?service_id=75f5f56cc6b74dac8b42c4f3a8d03dc3&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:46.567108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf6c91-bb36-48ea-b6fe-5c48b3034c29 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.567510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf6c91-bb36-48ea-b6fe-5c48b3034c29 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.567887 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf6c91-bb36-48ea-b6fe-5c48b3034c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.585451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8dcf6c91-bb36-48ea-b6fe-5c48b3034c29 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:46.586771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8dcf6c91-bb36-48ea-b6fe-5c48b3034c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:46.672605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 383/788] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:46.674163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf6c91-bb36-48ea-b6fe-5c48b3034c29 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:46.680986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf19c7-4a04-4c33-8c82-9a4714d6de87 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:46.727655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a42b0-431c-4eab-8d3d-49af1d72f628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:46.728426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a42b0-431c-4eab-8d3d-49af1d72f628 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.728639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a42b0-431c-4eab-8d3d-49af1d72f628 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.728919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a42b0-431c-4eab-8d3d-49af1d72f628 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.729787 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a42b0-431c-4eab-8d3d-49af1d72f628 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:46.730097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a42b0-431c-4eab-8d3d-49af1d72f628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:46.731523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a42b0-431c-4eab-8d3d-49af1d72f628 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:46.750812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 406/789] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Apr 12 14:06:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:46.751782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a42b0-431c-4eab-8d3d-49af1d72f628 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:46.808594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf6c91-bb36-48ea-b6fe-5c48b3034c29 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:46.843862 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16b5e1-00aa-41d8-accc-b477cd5a324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:46.844527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16b5e1-00aa-41d8-accc-b477cd5a324b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.845178 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16b5e1-00aa-41d8-accc-b477cd5a324b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.845836 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16b5e1-00aa-41d8-accc-b477cd5a324b None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.846586 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16b5e1-00aa-41d8-accc-b477cd5a324b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:46.848012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16b5e1-00aa-41d8-accc-b477cd5a324b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:46.851164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a42b0-431c-4eab-8d3d-49af1d72f628 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:46.853957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 384/790] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Apr 12 14:06:46 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:46.854148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16b5e1-00aa-41d8-accc-b477cd5a324b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:46.894985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77421281-fa2e-4037-a07c-edf9a83d1dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:46.895979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77421281-fa2e-4037-a07c-edf9a83d1dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.896267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77421281-fa2e-4037-a07c-edf9a83d1dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.896542 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77421281-fa2e-4037-a07c-edf9a83d1dd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.909027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77421281-fa2e-4037-a07c-edf9a83d1dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:46.916385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-77421281-fa2e-4037-a07c-edf9a83d1dd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:46.918079 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 407/791] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:46.919603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0d0ec-2882-4743-9ad6-8cc55f80b92c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:46.919891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0d0ec-2882-4743-9ad6-8cc55f80b92c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:46.920165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0d0ec-2882-4743-9ad6-8cc55f80b92c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:46.921759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 408/792] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:46.924487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0d0ec-2882-4743-9ad6-8cc55f80b92c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:47.002788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16b5e1-00aa-41d8-accc-b477cd5a324b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:47.041090 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0d0ec-2882-4743-9ad6-8cc55f80b92c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:47.046655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe78d75-13b3-44ce-a5cf-ef8501c4b6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:47.047304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe78d75-13b3-44ce-a5cf-ef8501c4b6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.047582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe78d75-13b3-44ce-a5cf-ef8501c4b6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.047922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe78d75-13b3-44ce-a5cf-ef8501c4b6d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.088522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061d9f-2aaf-4abf-b691-0fb9d8c46d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:47.089233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061d9f-2aaf-4abf-b691-0fb9d8c46d60 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.089515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061d9f-2aaf-4abf-b691-0fb9d8c46d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.089790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061d9f-2aaf-4abf-b691-0fb9d8c46d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.090533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061d9f-2aaf-4abf-b691-0fb9d8c46d60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:47.090841 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061d9f-2aaf-4abf-b691-0fb9d8c46d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:47.092216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061d9f-2aaf-4abf-b691-0fb9d8c46d60 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:47.102311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 409/793] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:47.103616 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50822b1-278b-4532-93d7-0a85a0a47093 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.103889 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50822b1-278b-4532-93d7-0a85a0a47093 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.104164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50822b1-278b-4532-93d7-0a85a0a47093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.128047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f50822b1-278b-4532-93d7-0a85a0a47093 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:47.130072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f50822b1-278b-4532-93d7-0a85a0a47093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:47.149467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe78d75-13b3-44ce-a5cf-ef8501c4b6d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:47.151527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe78d75-13b3-44ce-a5cf-ef8501c4b6d3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:47.211098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 410/794] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:47.217170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50822b1-278b-4532-93d7-0a85a0a47093 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:47.286923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 385/795] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:06:47.288006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe78d75-13b3-44ce-a5cf-ef8501c4b6d3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:47.369425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50822b1-278b-4532-93d7-0a85a0a47093 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:47.395399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe78d75-13b3-44ce-a5cf-ef8501c4b6d3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:47.410291 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff54c43-6fc3-483a-8fed-6900455c86cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:47.411369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54c43-6fc3-483a-8fed-6900455c86cf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.411793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54c43-6fc3-483a-8fed-6900455c86cf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.412217 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54c43-6fc3-483a-8fed-6900455c86cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.422816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff54c43-6fc3-483a-8fed-6900455c86cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:47.424760 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff54c43-6fc3-483a-8fed-6900455c86cf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:47.430346 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eef4d5-9a77-42d7-99d2-e09ba74d78bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:47.431136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef4d5-9a77-42d7-99d2-e09ba74d78bd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.431422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef4d5-9a77-42d7-99d2-e09ba74d78bd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.431697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef4d5-9a77-42d7-99d2-e09ba74d78bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.442759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eef4d5-9a77-42d7-99d2-e09ba74d78bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:47.443887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-4ff54c43-6fc3-483a-8fed-6900455c86cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:47.445859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 411/796] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:47.446884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff54c43-6fc3-483a-8fed-6900455c86cf None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:47.450087 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-83eef4d5-9a77-42d7-99d2-e09ba74d78bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:06:47.451577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 386/797] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:47.452416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eef4d5-9a77-42d7-99d2-e09ba74d78bd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:47.555780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff54c43-6fc3-483a-8fed-6900455c86cf None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:47.559152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eef4d5-9a77-42d7-99d2-e09ba74d78bd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:47.594521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79a23d-172f-4538-8d5c-fbb86df029df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:47.595546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79a23d-172f-4538-8d5c-fbb86df029df None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.595931 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79a23d-172f-4538-8d5c-fbb86df029df None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.596218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79a23d-172f-4538-8d5c-fbb86df029df None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.596945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79a23d-172f-4538-8d5c-fbb86df029df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:47.597407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79a23d-172f-4538-8d5c-fbb86df029df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:47.597818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf9b5-ac42-401e-b92f-9af4e00d1c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:47.598806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79a23d-172f-4538-8d5c-fbb86df029df None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:47.599029 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf9b5-ac42-401e-b92f-9af4e00d1c00 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.599506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf9b5-ac42-401e-b92f-9af4e00d1c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.599966 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf9b5-ac42-401e-b92f-9af4e00d1c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.611296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdf9b5-ac42-401e-b92f-9af4e00d1c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:47.612376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 387/798] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:47.613385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79a23d-172f-4538-8d5c-fbb86df029df None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:47.613894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdf9b5-ac42-401e-b92f-9af4e00d1c00 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:47.632888 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-bccdf9b5-ac42-401e-b92f-9af4e00d1c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:47.634747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 412/799] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:47.635743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf9b5-ac42-401e-b92f-9af4e00d1c00 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:47.732629 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79a23d-172f-4538-8d5c-fbb86df029df None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:47.740941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf9b5-ac42-401e-b92f-9af4e00d1c00 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:47.768121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153992a1-589f-44db-ae17-aeedc0207a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:47.769099 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153992a1-589f-44db-ae17-aeedc0207a5c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.769524 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153992a1-589f-44db-ae17-aeedc0207a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.769941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153992a1-589f-44db-ae17-aeedc0207a5c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.770846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153992a1-589f-44db-ae17-aeedc0207a5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:47.771298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153992a1-589f-44db-ae17-aeedc0207a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:47.772846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153992a1-589f-44db-ae17-aeedc0207a5c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:47.773902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a0c25-ce4d-432f-ae00-54b94ef7efdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:47.774738 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0c25-ce4d-432f-ae00-54b94ef7efdd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.775020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0c25-ce4d-432f-ae00-54b94ef7efdd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.775292 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0c25-ce4d-432f-ae00-54b94ef7efdd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.782019 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 388/800] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:47.783039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a0c25-ce4d-432f-ae00-54b94ef7efdd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:47.783760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153992a1-589f-44db-ae17-aeedc0207a5c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:47.784585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a0c25-ce4d-432f-ae00-54b94ef7efdd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:47.802262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-d60a0c25-ce4d-432f-ae00-54b94ef7efdd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 14:06:47.803533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 413/801] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Apr 12 14:06:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:47.808994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f9bd8-473a-4079-942c-d16b90c61e9b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.808994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f9bd8-473a-4079-942c-d16b90c61e9b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.808994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f9bd8-473a-4079-942c-d16b90c61e9b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.808994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 414/802] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:47.808994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f9bd8-473a-4079-942c-d16b90c61e9b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:47.889452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153992a1-589f-44db-ae17-aeedc0207a5c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:47.908394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f9bd8-473a-4079-942c-d16b90c61e9b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:47.925521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ef63f-e8a1-4ad7-85b7-7ff42f0a7a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:47.926434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ef63f-e8a1-4ad7-85b7-7ff42f0a7a1a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.926894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ef63f-e8a1-4ad7-85b7-7ff42f0a7a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.927315 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ef63f-e8a1-4ad7-85b7-7ff42f0a7a1a None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.928185 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ef63f-e8a1-4ad7-85b7-7ff42f0a7a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:47.928661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ef63f-e8a1-4ad7-85b7-7ff42f0a7a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:47.930087 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ef63f-e8a1-4ad7-85b7-7ff42f0a7a1a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:47.945435 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 389/803] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:47.947011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e64dc-85fe-4647-8169-f74de26d6bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:47.947803 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e64dc-85fe-4647-8169-f74de26d6bbb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.948083 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e64dc-85fe-4647-8169-f74de26d6bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.948355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e64dc-85fe-4647-8169-f74de26d6bbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:47.950940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ef63f-e8a1-4ad7-85b7-7ff42f0a7a1a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:47.958792 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e64dc-85fe-4647-8169-f74de26d6bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:47.960241 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e64dc-85fe-4647-8169-f74de26d6bbb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:47.978047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-9f1e64dc-85fe-4647-8169-f74de26d6bbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:47.980799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 415/804] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:47.983066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a0401-f778-476f-b8eb-cc4e90bff546 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:47.983981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a0401-f778-476f-b8eb-cc4e90bff546 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:47.984466 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a0401-f778-476f-b8eb-cc4e90bff546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:48.003600 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ab1a0401-f778-476f-b8eb-cc4e90bff546 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:48.004824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ab1a0401-f778-476f-b8eb-cc4e90bff546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:48.065965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ef63f-e8a1-4ad7-85b7-7ff42f0a7a1a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:48.077056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 416/805] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:48.077056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a0401-f778-476f-b8eb-cc4e90bff546 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:48.116347 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091967e7-ebd9-4ccb-aa13-b56f079de62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:48.117746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091967e7-ebd9-4ccb-aa13-b56f079de62b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:48.118030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091967e7-ebd9-4ccb-aa13-b56f079de62b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:48.118303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091967e7-ebd9-4ccb-aa13-b56f079de62b None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:48.119150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091967e7-ebd9-4ccb-aa13-b56f079de62b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:48.119459 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091967e7-ebd9-4ccb-aa13-b56f079de62b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:48.120895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091967e7-ebd9-4ccb-aa13-b56f079de62b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:48.147635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 390/806] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Apr 12 14:06:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:48.147635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091967e7-ebd9-4ccb-aa13-b56f079de62b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:48.189755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a0401-f778-476f-b8eb-cc4e90bff546 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:48.227239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fba3f-7af5-4734-a495-89d704fbae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:48.228049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fba3f-7af5-4734-a495-89d704fbae9d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:48.228328 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fba3f-7af5-4734-a495-89d704fbae9d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:48.228603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fba3f-7af5-4734-a495-89d704fbae9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:48.238806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fba3f-7af5-4734-a495-89d704fbae9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:48.240412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fba3f-7af5-4734-a495-89d704fbae9d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:48.254388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-118fba3f-7af5-4734-a495-89d704fbae9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:48.260196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 417/807] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:48.260196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fba3f-7af5-4734-a495-89d704fbae9d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:48.263325 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091967e7-ebd9-4ccb-aa13-b56f079de62b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:48.300298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05b06c-ccca-42af-8158-4cdc8e9ca8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:48.301548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05b06c-ccca-42af-8158-4cdc8e9ca8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:48.301840 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05b06c-ccca-42af-8158-4cdc8e9ca8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:48.302116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05b06c-ccca-42af-8158-4cdc8e9ca8e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:48.302834 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05b06c-ccca-42af-8158-4cdc8e9ca8e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:48.303144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05b06c-ccca-42af-8158-4cdc8e9ca8e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:48.305543 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05b06c-ccca-42af-8158-4cdc8e9ca8e9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:48.327158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 391/808] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:48.327158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05b06c-ccca-42af-8158-4cdc8e9ca8e9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:48.371597 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fba3f-7af5-4734-a495-89d704fbae9d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:48.411631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eb1cd-c7d7-46fc-9ac9-4a423aa4f518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:48.413235 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eb1cd-c7d7-46fc-9ac9-4a423aa4f518 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:48.413725 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eb1cd-c7d7-46fc-9ac9-4a423aa4f518 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:48.414682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eb1cd-c7d7-46fc-9ac9-4a423aa4f518 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:48.415804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68eb1cd-c7d7-46fc-9ac9-4a423aa4f518 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:48.418066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68eb1cd-c7d7-46fc-9ac9-4a423aa4f518 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:48.435464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05b06c-ccca-42af-8158-4cdc8e9ca8e9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:48.438520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-d68eb1cd-c7d7-46fc-9ac9-4a423aa4f518 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 14:06:48.440216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 418/809] 10.222.0.61 () {56 vars in 1129 bytes} [Tue Apr 12 14:06:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:48.441286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eb1cd-c7d7-46fc-9ac9-4a423aa4f518 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:48.468972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe63e9-038c-4c16-872f-1982ccb885f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:48.470493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe63e9-038c-4c16-872f-1982ccb885f7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:48.470990 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe63e9-038c-4c16-872f-1982ccb885f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:48.471355 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe63e9-038c-4c16-872f-1982ccb885f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:48.481397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe63e9-038c-4c16-872f-1982ccb885f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:48.482831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe63e9-038c-4c16-872f-1982ccb885f7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:48.499920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-a9fe63e9-038c-4c16-872f-1982ccb885f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:48.506561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 392/810] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:48.506561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe63e9-038c-4c16-872f-1982ccb885f7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:48.545890 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eb1cd-c7d7-46fc-9ac9-4a423aa4f518 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:48.582676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ec42-3122-4e62-9b5d-417a936fb3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:48.583353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ec42-3122-4e62-9b5d-417a936fb3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:48.583646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ec42-3122-4e62-9b5d-417a936fb3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:48.583927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ec42-3122-4e62-9b5d-417a936fb3d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:48.584712 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754ec42-3122-4e62-9b5d-417a936fb3d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:48.585117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754ec42-3122-4e62-9b5d-417a936fb3d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:48.586622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754ec42-3122-4e62-9b5d-417a936fb3d6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:48.599884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 419/811] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:48.600823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ec42-3122-4e62-9b5d-417a936fb3d6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:48.611447 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe63e9-038c-4c16-872f-1982ccb885f7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:48.645666 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bfb15-71b6-4dc8-90f3-e74024524dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:48.646458 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bfb15-71b6-4dc8-90f3-e74024524dcd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:48.646736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bfb15-71b6-4dc8-90f3-e74024524dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:48.647005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bfb15-71b6-4dc8-90f3-e74024524dcd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:48.654421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bfb15-71b6-4dc8-90f3-e74024524dcd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:48.655856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bfb15-71b6-4dc8-90f3-e74024524dcd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:48.672318 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-854bfb15-71b6-4dc8-90f3-e74024524dcd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 14:06:48.674122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 393/812] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:48.674888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bfb15-71b6-4dc8-90f3-e74024524dcd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:48.708603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ec42-3122-4e62-9b5d-417a936fb3d6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:48.744780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7517-9247-4963-9911-949bb359d4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:48.745478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7517-9247-4963-9911-949bb359d4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:48.745769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7517-9247-4963-9911-949bb359d4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:48.746046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7517-9247-4963-9911-949bb359d4d8 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:48.746758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b7517-9247-4963-9911-949bb359d4d8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:48.747068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b7517-9247-4963-9911-949bb359d4d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:48.748442 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b7517-9247-4963-9911-949bb359d4d8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:48.753072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 420/813] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Apr 12 14:06:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:48.753870 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7517-9247-4963-9911-949bb359d4d8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:48.781540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bfb15-71b6-4dc8-90f3-e74024524dcd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:48.817217 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab8528-8bbd-46e2-b079-8ede628e4fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:48.817890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab8528-8bbd-46e2-b079-8ede628e4fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:48.818172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab8528-8bbd-46e2-b079-8ede628e4fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:48.818448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab8528-8bbd-46e2-b079-8ede628e4fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:48.819177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab8528-8bbd-46e2-b079-8ede628e4fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:48.819489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab8528-8bbd-46e2-b079-8ede628e4fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:48.821173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab8528-8bbd-46e2-b079-8ede628e4fa0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:48.834131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 394/814] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:48.834990 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab8528-8bbd-46e2-b079-8ede628e4fa0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:48.864615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7517-9247-4963-9911-949bb359d4d8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:48.903052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde44ce-be8e-44e1-a899-caa98e239ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:48.903904 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde44ce-be8e-44e1-a899-caa98e239ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:48.904075 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde44ce-be8e-44e1-a899-caa98e239ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:48.904581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde44ce-be8e-44e1-a899-caa98e239ea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:48.905298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde44ce-be8e-44e1-a899-caa98e239ea5 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=b9933c6dc8f74cd59f6a1f8c11abf652) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:48.905617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde44ce-be8e-44e1-a899-caa98e239ea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:48.907325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde44ce-be8e-44e1-a899-caa98e239ea5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:48.913760 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 421/815] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:48 2022] GET /identity/v3/role_assignments?user.id=b9933c6dc8f74cd59f6a1f8c11abf652&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:48.914611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde44ce-be8e-44e1-a899-caa98e239ea5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:48.968540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab8528-8bbd-46e2-b079-8ede628e4fa0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:49.008624 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ec876-2d32-4948-99d4-21557e7f28be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:49.009712 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ec876-2d32-4948-99d4-21557e7f28be None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:49.010239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ec876-2d32-4948-99d4-21557e7f28be None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:49.010710 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ec876-2d32-4948-99d4-21557e7f28be None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:49.011825 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ec876-2d32-4948-99d4-21557e7f28be None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:49.012383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ec876-2d32-4948-99d4-21557e7f28be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:49.014099 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ec876-2d32-4948-99d4-21557e7f28be None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:49.030889 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde44ce-be8e-44e1-a899-caa98e239ea5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:49.035130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 395/816] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Apr 12 14:06:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:49.036289 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ec876-2d32-4948-99d4-21557e7f28be None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:49.071437 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38752d-3f01-47d3-9238-accb307a76e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:49.072160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38752d-3f01-47d3-9238-accb307a76e8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:49.072489 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38752d-3f01-47d3-9238-accb307a76e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:49.072869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38752d-3f01-47d3-9238-accb307a76e8 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:49.073615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38752d-3f01-47d3-9238-accb307a76e8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:49.073971 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38752d-3f01-47d3-9238-accb307a76e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:49.075544 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38752d-3f01-47d3-9238-accb307a76e8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:49.087282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 422/817] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Apr 12 14:06:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:49.088359 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38752d-3f01-47d3-9238-accb307a76e8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:49.158146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ec876-2d32-4948-99d4-21557e7f28be None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:49.206910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f59d04-ef04-4b4e-9cbd-e57478c5ad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:49.207712 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f59d04-ef04-4b4e-9cbd-e57478c5ad8d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:49.208021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f59d04-ef04-4b4e-9cbd-e57478c5ad8d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:49.208412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f59d04-ef04-4b4e-9cbd-e57478c5ad8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:49.220404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f59d04-ef04-4b4e-9cbd-e57478c5ad8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:49.221910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f59d04-ef04-4b4e-9cbd-e57478c5ad8d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:49.224158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38752d-3f01-47d3-9238-accb307a76e8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:49.236258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-c8f59d04-ef04-4b4e-9cbd-e57478c5ad8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:49.237975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 396/818] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:49.238768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f59d04-ef04-4b4e-9cbd-e57478c5ad8d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:49.269602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb948144-0a67-4231-856d-1c68f636bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:49.270574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb948144-0a67-4231-856d-1c68f636bd84 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:49.271183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb948144-0a67-4231-856d-1c68f636bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:49.271610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb948144-0a67-4231-856d-1c68f636bd84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:49.284947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb948144-0a67-4231-856d-1c68f636bd84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:49.286906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb948144-0a67-4231-856d-1c68f636bd84 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:49.310635 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-cb948144-0a67-4231-856d-1c68f636bd84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:49.311993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 423/819] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:49.313178 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb948144-0a67-4231-856d-1c68f636bd84 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:49.344184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f59d04-ef04-4b4e-9cbd-e57478c5ad8d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:49.378654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392c3f2-1cea-4797-b58a-cdd5b02acb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:49.379315 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c3f2-1cea-4797-b58a-cdd5b02acb64 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:49.379599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c3f2-1cea-4797-b58a-cdd5b02acb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:49.379877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c3f2-1cea-4797-b58a-cdd5b02acb64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:49.380727 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392c3f2-1cea-4797-b58a-cdd5b02acb64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:49.382274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392c3f2-1cea-4797-b58a-cdd5b02acb64 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:49.410869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb948144-0a67-4231-856d-1c68f636bd84 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:49.444450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f7b0b-bfbe-4bc3-a6e4-8c4b66a996c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:49.445153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f7b0b-bfbe-4bc3-a6e4-8c4b66a996c4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:49.445438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f7b0b-bfbe-4bc3-a6e4-8c4b66a996c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:49.445966 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f7b0b-bfbe-4bc3-a6e4-8c4b66a996c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:49.446749 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f7b0b-bfbe-4bc3-a6e4-8c4b66a996c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:49.447055 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f7b0b-bfbe-4bc3-a6e4-8c4b66a996c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:49.448479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f7b0b-bfbe-4bc3-a6e4-8c4b66a996c4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:49.460631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 424/820] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:49.466522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd32aef-9665-435d-97e4-6465d56ae50b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:49.466522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd32aef-9665-435d-97e4-6465d56ae50b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:49.466522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd32aef-9665-435d-97e4-6465d56ae50b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:49.466522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 425/821] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:49.466522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd32aef-9665-435d-97e4-6465d56ae50b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:49.467549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 397/822] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Apr 12 14:06:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:49.468483 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392c3f2-1cea-4797-b58a-cdd5b02acb64 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:49.595164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd32aef-9665-435d-97e4-6465d56ae50b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:49.614592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392c3f2-1cea-4797-b58a-cdd5b02acb64 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:49.634819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923c7bd-bbcf-44a1-a037-e61356adf6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:49.635729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c7bd-bbcf-44a1-a037-e61356adf6fc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:49.636109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c7bd-bbcf-44a1-a037-e61356adf6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:49.636486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c7bd-bbcf-44a1-a037-e61356adf6fc None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:49.637421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923c7bd-bbcf-44a1-a037-e61356adf6fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:49.637855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923c7bd-bbcf-44a1-a037-e61356adf6fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:49.639417 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923c7bd-bbcf-44a1-a037-e61356adf6fc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:49.653735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b79e1-9302-4f68-a1e9-926f0109f2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:49.655000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b79e1-9302-4f68-a1e9-926f0109f2e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:49.655491 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b79e1-9302-4f68-a1e9-926f0109f2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:49.655972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b79e1-9302-4f68-a1e9-926f0109f2e8 None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/e84a4f86f4c54625a22cfdcbc08da73b/roles/316db11de3994c7b86fcc1bba9da56bc` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:49.658067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 426/823] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:49.659570 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c50c-d9d2-40a6-9108-b4f5e527f67c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:49.659862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c50c-d9d2-40a6-9108-b4f5e527f67c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:49.660142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c50c-d9d2-40a6-9108-b4f5e527f67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:49.678466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b79e1-9302-4f68-a1e9-926f0109f2e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=e84a4f86f4c54625a22cfdcbc08da73b, role_id=316db11de3994c7b86fcc1bba9da56bc)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:49.680268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b79e1-9302-4f68-a1e9-926f0109f2e8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:49.681838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ed71c50c-d9d2-40a6-9108-b4f5e527f67c None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:49.683066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ed71c50c-d9d2-40a6-9108-b4f5e527f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:49.736025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 398/824] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:06:49 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/e84a4f86f4c54625a22cfdcbc08da73b/roles/316db11de3994c7b86fcc1bba9da56bc => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:06:49.737280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b79e1-9302-4f68-a1e9-926f0109f2e8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:49.765623 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 427/825] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:49.800713 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71c50c-d9d2-40a6-9108-b4f5e527f67c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:49.868229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b79e1-9302-4f68-a1e9-926f0109f2e8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:49.911724 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d532b8-2903-4d71-b40d-f05b4d2c9069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:49.912637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d532b8-2903-4d71-b40d-f05b4d2c9069 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:49.912919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d532b8-2903-4d71-b40d-f05b4d2c9069 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:49.913252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d532b8-2903-4d71-b40d-f05b4d2c9069 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:49.930846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d532b8-2903-4d71-b40d-f05b4d2c9069 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:49.933959 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d532b8-2903-4d71-b40d-f05b4d2c9069 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:49.955098 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-48d532b8-2903-4d71-b40d-f05b4d2c9069 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:49.956708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 399/826] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:49.966047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d532b8-2903-4d71-b40d-f05b4d2c9069 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:49.996184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71c50c-d9d2-40a6-9108-b4f5e527f67c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:50.035504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b3ef8-43f7-47cd-9f9a-c4bbee036e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:50.036700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b3ef8-43f7-47cd-9f9a-c4bbee036e90 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:50.037209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b3ef8-43f7-47cd-9f9a-c4bbee036e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:50.037686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b3ef8-43f7-47cd-9f9a-c4bbee036e90 None admin] PATH_INFO: `/v3/services/network` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:50.038550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b3ef8-43f7-47cd-9f9a-c4bbee036e90 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:50.040104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b3ef8-43f7-47cd-9f9a-c4bbee036e90 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:50.052523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-e65b3ef8-43f7-47cd-9f9a-c4bbee036e90 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 14:06:50.054313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 428/827] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:49 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:50.060222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b3ef8-43f7-47cd-9f9a-c4bbee036e90 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:50.089943 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d532b8-2903-4d71-b40d-f05b4d2c9069 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:50.126281 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c7dbb-edd6-493d-8a0f-a1fc455f2e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:50.127339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c7dbb-edd6-493d-8a0f-a1fc455f2e49 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:50.127629 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c7dbb-edd6-493d-8a0f-a1fc455f2e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:50.127904 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c7dbb-edd6-493d-8a0f-a1fc455f2e49 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:50.128781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c7dbb-edd6-493d-8a0f-a1fc455f2e49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:50.129195 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c7dbb-edd6-493d-8a0f-a1fc455f2e49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:50.130728 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c7dbb-edd6-493d-8a0f-a1fc455f2e49 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:50.145057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 400/828] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:50.152847 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c7dbb-edd6-493d-8a0f-a1fc455f2e49 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:50.184389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b3ef8-43f7-47cd-9f9a-c4bbee036e90 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:50.245124 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e0316-1d5e-4914-bf02-fbf531c7a111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:50.245952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e0316-1d5e-4914-bf02-fbf531c7a111 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:50.246237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e0316-1d5e-4914-bf02-fbf531c7a111 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:50.246558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e0316-1d5e-4914-bf02-fbf531c7a111 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:50.247587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e0316-1d5e-4914-bf02-fbf531c7a111 None admin] RBAC: Adding query filter params (name=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:50.247717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e0316-1d5e-4914-bf02-fbf531c7a111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:50.249222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e0316-1d5e-4914-bf02-fbf531c7a111 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:50.260469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c7dbb-edd6-493d-8a0f-a1fc455f2e49 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:50.263851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 429/829] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:06:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:50.271411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e0316-1d5e-4914-bf02-fbf531c7a111 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:50.302982 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77491f94-26e0-4a0b-bbf6-7253fae97091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:50.304393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77491f94-26e0-4a0b-bbf6-7253fae97091 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:50.304887 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77491f94-26e0-4a0b-bbf6-7253fae97091 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:50.305401 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77491f94-26e0-4a0b-bbf6-7253fae97091 None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/987dcad83b914b5894955dfe3e1f71ab/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:50.307667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77491f94-26e0-4a0b-bbf6-7253fae97091 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=987dcad83b914b5894955dfe3e1f71ab, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:50.309353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77491f94-26e0-4a0b-bbf6-7253fae97091 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:50.396049 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 401/830] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:06:50 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/987dcad83b914b5894955dfe3e1f71ab/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:06:50.398420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e0316-1d5e-4914-bf02-fbf531c7a111 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:50.441417 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35015627-3dde-4dcc-99c7-a0437c33306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:50.442104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35015627-3dde-4dcc-99c7-a0437c33306d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:50.442375 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35015627-3dde-4dcc-99c7-a0437c33306d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:50.442654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35015627-3dde-4dcc-99c7-a0437c33306d None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:50.443376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35015627-3dde-4dcc-99c7-a0437c33306d None admin] RBAC: Adding query filter params (type=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:50.443682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35015627-3dde-4dcc-99c7-a0437c33306d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:50.445108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35015627-3dde-4dcc-99c7-a0437c33306d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:50.451200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 430/831] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:06:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:50.457683 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77491f94-26e0-4a0b-bbf6-7253fae97091 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:50.588918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77491f94-26e0-4a0b-bbf6-7253fae97091 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:50.630501 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded09bd-8da0-4a2d-91e3-8aa9ff9f8fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:50.631158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded09bd-8da0-4a2d-91e3-8aa9ff9f8fb4 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:50.631439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded09bd-8da0-4a2d-91e3-8aa9ff9f8fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:50.631715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded09bd-8da0-4a2d-91e3-8aa9ff9f8fb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:50.632456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded09bd-8da0-4a2d-91e3-8aa9ff9f8fb4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:50.633841 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded09bd-8da0-4a2d-91e3-8aa9ff9f8fb4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:50.718450 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 402/832] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Apr 12 14:06:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:51.472440 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaaa1e-9cd2-404b-a0f6-dfe1e9d98757 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:51.473486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaaa1e-9cd2-404b-a0f6-dfe1e9d98757 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:51.473974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaaa1e-9cd2-404b-a0f6-dfe1e9d98757 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:51.475836 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 431/833] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:51.480923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a1f7-00fb-4e1a-aef0-989f58fec273 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:51.481806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a1f7-00fb-4e1a-aef0-989f58fec273 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:51.482278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a1f7-00fb-4e1a-aef0-989f58fec273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:51.501421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f5c3a1f7-00fb-4e1a-aef0-989f58fec273 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:51.502601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f5c3a1f7-00fb-4e1a-aef0-989f58fec273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:51.577810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 403/834] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:51.600204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebaaa1e-9cd2-404b-a0f6-dfe1e9d98757 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:51.721817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebaaa1e-9cd2-404b-a0f6-dfe1e9d98757 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:51.757523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f486c9-bb50-4a00-b272-18507fcbc28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:51.758283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f486c9-bb50-4a00-b272-18507fcbc28e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:51.758567 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f486c9-bb50-4a00-b272-18507fcbc28e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:51.758845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f486c9-bb50-4a00-b272-18507fcbc28e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:51.759512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f486c9-bb50-4a00-b272-18507fcbc28e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:51.760940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f486c9-bb50-4a00-b272-18507fcbc28e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:51.773496 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-49f486c9-bb50-4a00-b272-18507fcbc28e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 14:06:51.775378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 432/835] 10.222.0.61 () {56 vars in 1132 bytes} [Tue Apr 12 14:06:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:51.783436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a1f7-00fb-4e1a-aef0-989f58fec273 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:51.905308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a1f7-00fb-4e1a-aef0-989f58fec273 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:51.949777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30abac-b8d5-4086-8b1f-ae55f8450d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:51.950888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30abac-b8d5-4086-8b1f-ae55f8450d57 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:51.951447 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30abac-b8d5-4086-8b1f-ae55f8450d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:51.952046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30abac-b8d5-4086-8b1f-ae55f8450d57 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:51.953260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30abac-b8d5-4086-8b1f-ae55f8450d57 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:51.954419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30abac-b8d5-4086-8b1f-ae55f8450d57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:51.956455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30abac-b8d5-4086-8b1f-ae55f8450d57 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:51.962694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 404/836] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Apr 12 14:06:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:51.970060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f486c9-bb50-4a00-b272-18507fcbc28e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:52.080352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f486c9-bb50-4a00-b272-18507fcbc28e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:52.114759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11011b83-8828-4cdc-aeae-cb766c4be9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:52.115435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011b83-8828-4cdc-aeae-cb766c4be9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:52.115723 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011b83-8828-4cdc-aeae-cb766c4be9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:52.116002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011b83-8828-4cdc-aeae-cb766c4be9b3 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:52.116718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11011b83-8828-4cdc-aeae-cb766c4be9b3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:52.117053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11011b83-8828-4cdc-aeae-cb766c4be9b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:52.118424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11011b83-8828-4cdc-aeae-cb766c4be9b3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:52.123558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 433/837] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Apr 12 14:06:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:52.170000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca9915-929a-401a-b2bc-d7ef24839272 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:52.170310 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca9915-929a-401a-b2bc-d7ef24839272 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:52.170564 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca9915-929a-401a-b2bc-d7ef24839272 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:52.172237 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 405/838] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:52.179588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062e1c3-3292-4c50-bc82-4ca9d073de26 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:52.179916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062e1c3-3292-4c50-bc82-4ca9d073de26 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:52.180182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062e1c3-3292-4c50-bc82-4ca9d073de26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:52.200541 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d062e1c3-3292-4c50-bc82-4ca9d073de26 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:52.201808 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d062e1c3-3292-4c50-bc82-4ca9d073de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:52.277430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 434/839] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:52.301356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca9915-929a-401a-b2bc-d7ef24839272 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:52.407970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca9915-929a-401a-b2bc-d7ef24839272 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:52.443476 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40e593-27ec-4847-87f2-b3949921f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:52.444283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40e593-27ec-4847-87f2-b3949921f781 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:52.444566 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40e593-27ec-4847-87f2-b3949921f781 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:52.444838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40e593-27ec-4847-87f2-b3949921f781 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:52.445791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40e593-27ec-4847-87f2-b3949921f781 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:52.447180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40e593-27ec-4847-87f2-b3949921f781 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:52.458929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-ea40e593-27ec-4847-87f2-b3949921f781 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 14:06:52.460533 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 406/840] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:06:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:52.467780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062e1c3-3292-4c50-bc82-4ca9d073de26 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:52.571855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062e1c3-3292-4c50-bc82-4ca9d073de26 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:52.584654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568267d-9306-475b-be02-ebd51e0f5516 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:52.585888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568267d-9306-475b-be02-ebd51e0f5516 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:52.586614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568267d-9306-475b-be02-ebd51e0f5516 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:52.589849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 407/841] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:06:52.596443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ef7e7-0748-44be-842e-dab3be186ddb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:52.596937 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ef7e7-0748-44be-842e-dab3be186ddb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:52.597407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ef7e7-0748-44be-842e-dab3be186ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:52.608818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cbadb-0be4-49e6-8aa5-1ddc84907e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:52.609525 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cbadb-0be4-49e6-8aa5-1ddc84907e2e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:52.609844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cbadb-0be4-49e6-8aa5-1ddc84907e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:52.610131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cbadb-0be4-49e6-8aa5-1ddc84907e2e None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:52.611089 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cbadb-0be4-49e6-8aa5-1ddc84907e2e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:52.611613 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cbadb-0be4-49e6-8aa5-1ddc84907e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:52.614094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cbadb-0be4-49e6-8aa5-1ddc84907e2e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:52.619503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 435/842] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:06:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:52.624281 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8c1ef7e7-0748-44be-842e-dab3be186ddb None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:52.624871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cbadb-0be4-49e6-8aa5-1ddc84907e2e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:52.626215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8c1ef7e7-0748-44be-842e-dab3be186ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:52.698343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 408/843] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:06:52.724953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ef7e7-0748-44be-842e-dab3be186ddb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:52.738841 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cbadb-0be4-49e6-8aa5-1ddc84907e2e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:52.776894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2354da-56a2-44a1-a961-9035d06f6937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:52.777613 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2354da-56a2-44a1-a961-9035d06f6937 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:52.777897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2354da-56a2-44a1-a961-9035d06f6937 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:52.778174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2354da-56a2-44a1-a961-9035d06f6937 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:52.778897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2354da-56a2-44a1-a961-9035d06f6937 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:52.779208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2354da-56a2-44a1-a961-9035d06f6937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:52.782474 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2354da-56a2-44a1-a961-9035d06f6937 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:52.789782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 436/844] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:06:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:52.846094 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ef7e7-0748-44be-842e-dab3be186ddb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:52.887551 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bacf1d-3c86-4b00-beec-f49904bc4429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:52.888783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bacf1d-3c86-4b00-beec-f49904bc4429 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:52.889340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bacf1d-3c86-4b00-beec-f49904bc4429 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:52.889829 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bacf1d-3c86-4b00-beec-f49904bc4429 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:52.902277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bacf1d-3c86-4b00-beec-f49904bc4429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:52.909983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-f5bacf1d-3c86-4b00-beec-f49904bc4429 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:06:52.911954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 409/845] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:06:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:52.918152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2354da-56a2-44a1-a961-9035d06f6937 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:53.027787 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2354da-56a2-44a1-a961-9035d06f6937 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:53.063645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859bfb7-3b79-45d4-9d40-aefa14c3c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:53.064570 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859bfb7-3b79-45d4-9d40-aefa14c3c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:53.065094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859bfb7-3b79-45d4-9d40-aefa14c3c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:53.065510 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859bfb7-3b79-45d4-9d40-aefa14c3c7d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:53.066399 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859bfb7-3b79-45d4-9d40-aefa14c3c7d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:53.066863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859bfb7-3b79-45d4-9d40-aefa14c3c7d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:53.068403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859bfb7-3b79-45d4-9d40-aefa14c3c7d7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:53.077885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 437/846] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:06:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:53.084323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bacf1d-3c86-4b00-beec-f49904bc4429 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:53.181233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922c06f-a501-416a-a50c-781df11e665f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:53.181427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922c06f-a501-416a-a50c-781df11e665f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:53.181713 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922c06f-a501-416a-a50c-781df11e665f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:53.184319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 438/847] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:06:53.189208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e38bd-53cb-40fc-a28f-df1120d54ebd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:53.189564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e38bd-53cb-40fc-a28f-df1120d54ebd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:53.189849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e38bd-53cb-40fc-a28f-df1120d54ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:53.190779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bacf1d-3c86-4b00-beec-f49904bc4429 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:53.207229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-356e38bd-53cb-40fc-a28f-df1120d54ebd None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:53.208363 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-356e38bd-53cb-40fc-a28f-df1120d54ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:53.228265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37893c-a2e0-4858-9d7d-82d6a3acb0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:53.229335 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37893c-a2e0-4858-9d7d-82d6a3acb0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:53.229758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37893c-a2e0-4858-9d7d-82d6a3acb0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:53.230204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37893c-a2e0-4858-9d7d-82d6a3acb0e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:53.243487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37893c-a2e0-4858-9d7d-82d6a3acb0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:53.244995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37893c-a2e0-4858-9d7d-82d6a3acb0e6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:53.271437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-eb37893c-a2e0-4858-9d7d-82d6a3acb0e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:53.277569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 410/848] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:53.278526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37893c-a2e0-4858-9d7d-82d6a3acb0e6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:53.294852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 439/849] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:06:53.319799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e38bd-53cb-40fc-a28f-df1120d54ebd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:53.394553 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37893c-a2e0-4858-9d7d-82d6a3acb0e6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:53.434805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9f4ed-92a0-4d69-9f1f-d09490ff7def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:53.435548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9f4ed-92a0-4d69-9f1f-d09490ff7def None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:53.435835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9f4ed-92a0-4d69-9f1f-d09490ff7def None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:53.436165 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9f4ed-92a0-4d69-9f1f-d09490ff7def None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:53.437045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e38bd-53cb-40fc-a28f-df1120d54ebd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:53.437179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9f4ed-92a0-4d69-9f1f-d09490ff7def None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:53.437356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9f4ed-92a0-4d69-9f1f-d09490ff7def None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:53.439795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9f4ed-92a0-4d69-9f1f-d09490ff7def None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:53.454097 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 411/850] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:53.460679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9f4ed-92a0-4d69-9f1f-d09490ff7def None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:53.481319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7f266-224e-4cc7-baff-f6ef3bc2ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:53.483337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7f266-224e-4cc7-baff-f6ef3bc2ed2c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:53.483893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7f266-224e-4cc7-baff-f6ef3bc2ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:53.484537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7f266-224e-4cc7-baff-f6ef3bc2ed2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:53.499191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7f266-224e-4cc7-baff-f6ef3bc2ed2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:53.509631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-e5c7f266-224e-4cc7-baff-f6ef3bc2ed2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:06:53.511903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 440/851] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:53.518043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7f266-224e-4cc7-baff-f6ef3bc2ed2c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:53.566689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9f4ed-92a0-4d69-9f1f-d09490ff7def None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:53.602408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80534b55-2ab8-462f-98ff-5d538f23b970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:53.603217 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80534b55-2ab8-462f-98ff-5d538f23b970 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:53.603511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80534b55-2ab8-462f-98ff-5d538f23b970 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:53.603781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80534b55-2ab8-462f-98ff-5d538f23b970 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:53.612343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80534b55-2ab8-462f-98ff-5d538f23b970 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:53.613961 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80534b55-2ab8-462f-98ff-5d538f23b970 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:53.630030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-80534b55-2ab8-462f-98ff-5d538f23b970 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 14:06:53.636183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 412/852] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Apr 12 14:06:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:53.636724 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80534b55-2ab8-462f-98ff-5d538f23b970 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:53.661547 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7f266-224e-4cc7-baff-f6ef3bc2ed2c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:53.723588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8677f-96a1-4f8e-b7f7-75a91f18e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:53.724184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8677f-96a1-4f8e-b7f7-75a91f18e32d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:53.724469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8677f-96a1-4f8e-b7f7-75a91f18e32d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:53.724745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8677f-96a1-4f8e-b7f7-75a91f18e32d None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:53.725524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8677f-96a1-4f8e-b7f7-75a91f18e32d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:53.725834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8677f-96a1-4f8e-b7f7-75a91f18e32d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:53.727674 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8677f-96a1-4f8e-b7f7-75a91f18e32d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:53.741125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 441/853] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:53.745475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8677f-96a1-4f8e-b7f7-75a91f18e32d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:53.757616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80534b55-2ab8-462f-98ff-5d538f23b970 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:53.801065 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1d5d5-110d-4775-a77e-a0693a574a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:53.801790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d5d5-110d-4775-a77e-a0693a574a01 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:53.802433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d5d5-110d-4775-a77e-a0693a574a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:53.802719 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d5d5-110d-4775-a77e-a0693a574a01 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:53.803876 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1d5d5-110d-4775-a77e-a0693a574a01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:53.804192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1d5d5-110d-4775-a77e-a0693a574a01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:53.805978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1d5d5-110d-4775-a77e-a0693a574a01 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:53.833236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 413/854] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Apr 12 14:06:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:53.835864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1d5d5-110d-4775-a77e-a0693a574a01 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:53.864915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8677f-96a1-4f8e-b7f7-75a91f18e32d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:53.899896 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d55707-a6d6-4968-91af-1ed809756a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:53.900851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d55707-a6d6-4968-91af-1ed809756a22 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:53.901345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d55707-a6d6-4968-91af-1ed809756a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:53.901718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d55707-a6d6-4968-91af-1ed809756a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:53.913240 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d55707-a6d6-4968-91af-1ed809756a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:53.914859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d55707-a6d6-4968-91af-1ed809756a22 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:53.932133 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-51d55707-a6d6-4968-91af-1ed809756a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:53.933879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 442/855] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:53.939943 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d55707-a6d6-4968-91af-1ed809756a22 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:53.944255 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1d5d5-110d-4775-a77e-a0693a574a01 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:53.992009 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b6c51-0074-401a-9cb0-dc1c4885b04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:53.992585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6c51-0074-401a-9cb0-dc1c4885b04e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:53.992870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6c51-0074-401a-9cb0-dc1c4885b04e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:53.993172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6c51-0074-401a-9cb0-dc1c4885b04e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:54.076999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d55707-a6d6-4968-91af-1ed809756a22 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:54.090527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b6c51-0074-401a-9cb0-dc1c4885b04e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:54.095359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b6c51-0074-401a-9cb0-dc1c4885b04e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:54.114354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb460fc3-7db7-4de5-a061-70d4f3191eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:54.115067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460fc3-7db7-4de5-a061-70d4f3191eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:54.115355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460fc3-7db7-4de5-a061-70d4f3191eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:54.115633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460fc3-7db7-4de5-a061-70d4f3191eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:54.116362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb460fc3-7db7-4de5-a061-70d4f3191eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:54.116670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb460fc3-7db7-4de5-a061-70d4f3191eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:54.118143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb460fc3-7db7-4de5-a061-70d4f3191eb2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:54.136809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 443/856] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:54.138324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb460fc3-7db7-4de5-a061-70d4f3191eb2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:54.255954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 414/857] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:06:54.262977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b6c51-0074-401a-9cb0-dc1c4885b04e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:54.273354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb460fc3-7db7-4de5-a061-70d4f3191eb2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:54.309205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cd527-27bb-481b-a29e-c7d4bc0e5a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:54.310137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cd527-27bb-481b-a29e-c7d4bc0e5a25 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:54.310425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cd527-27bb-481b-a29e-c7d4bc0e5a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:54.310707 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cd527-27bb-481b-a29e-c7d4bc0e5a25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:54.318747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cd527-27bb-481b-a29e-c7d4bc0e5a25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:54.320626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cd527-27bb-481b-a29e-c7d4bc0e5a25 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:54.334630 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-421cd527-27bb-481b-a29e-c7d4bc0e5a25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 14:06:54.340554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 444/858] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:06:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:54.341831 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cd527-27bb-481b-a29e-c7d4bc0e5a25 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:54.363957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b6c51-0074-401a-9cb0-dc1c4885b04e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:54.398781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a648e-112d-48bd-9c15-ad6da058d220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:54.399839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a648e-112d-48bd-9c15-ad6da058d220 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:54.400294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a648e-112d-48bd-9c15-ad6da058d220 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:54.400726 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a648e-112d-48bd-9c15-ad6da058d220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:54.411284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a648e-112d-48bd-9c15-ad6da058d220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:54.412953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a648e-112d-48bd-9c15-ad6da058d220 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:54.430609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-494a648e-112d-48bd-9c15-ad6da058d220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:54.436803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 415/859] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:54.438425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a648e-112d-48bd-9c15-ad6da058d220 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:54.446884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cd527-27bb-481b-a29e-c7d4bc0e5a25 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:54.487805 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c973037-62ab-4921-9363-608986bb2785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:54.489230 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973037-62ab-4921-9363-608986bb2785 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:54.489691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973037-62ab-4921-9363-608986bb2785 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:54.490475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973037-62ab-4921-9363-608986bb2785 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:54.491796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c973037-62ab-4921-9363-608986bb2785 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:54.492398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c973037-62ab-4921-9363-608986bb2785 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:54.494270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c973037-62ab-4921-9363-608986bb2785 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:54.518628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 445/860] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Apr 12 14:06:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:54.524178 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c973037-62ab-4921-9363-608986bb2785 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:54.556379 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a648e-112d-48bd-9c15-ad6da058d220 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:54.591326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260a46a-60ad-4af3-b45d-9afd24606f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:54.592027 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260a46a-60ad-4af3-b45d-9afd24606f47 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:54.592312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260a46a-60ad-4af3-b45d-9afd24606f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:54.592588 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260a46a-60ad-4af3-b45d-9afd24606f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:54.593362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260a46a-60ad-4af3-b45d-9afd24606f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:54.593673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260a46a-60ad-4af3-b45d-9afd24606f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:54.595802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260a46a-60ad-4af3-b45d-9afd24606f47 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:54.612550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 416/861] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:54.614016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260a46a-60ad-4af3-b45d-9afd24606f47 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:54.649575 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c973037-62ab-4921-9363-608986bb2785 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:54.691657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11199e1-699b-483d-879a-3192ebf9c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:54.692332 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11199e1-699b-483d-879a-3192ebf9c482 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:54.692588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11199e1-699b-483d-879a-3192ebf9c482 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:54.692872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11199e1-699b-483d-879a-3192ebf9c482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:54.743415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260a46a-60ad-4af3-b45d-9afd24606f47 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:54.770910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11199e1-699b-483d-879a-3192ebf9c482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:54.772712 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11199e1-699b-483d-879a-3192ebf9c482 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:54.785252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018837c5-e1ad-4b6b-b5a3-fdd51bdd72d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:54.786058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018837c5-e1ad-4b6b-b5a3-fdd51bdd72d4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:54.786341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018837c5-e1ad-4b6b-b5a3-fdd51bdd72d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:54.786616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018837c5-e1ad-4b6b-b5a3-fdd51bdd72d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:54.795931 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018837c5-e1ad-4b6b-b5a3-fdd51bdd72d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:54.799136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018837c5-e1ad-4b6b-b5a3-fdd51bdd72d4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:54.822336 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-018837c5-e1ad-4b6b-b5a3-fdd51bdd72d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:54.824671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 417/862] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:54.826844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c2df6-704d-427b-9b36-09e53c9751c5 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:54.827284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c2df6-704d-427b-9b36-09e53c9751c5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:54.827708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c2df6-704d-427b-9b36-09e53c9751c5 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:54.835419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 418/863] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:54.835419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c2df6-704d-427b-9b36-09e53c9751c5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:54.890743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 446/864] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 14:06:54.890743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893354d-a783-48a3-abb9-305b1ece1efc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:54.890743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893354d-a783-48a3-abb9-305b1ece1efc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:54.890743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893354d-a783-48a3-abb9-305b1ece1efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:54.904152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9893354d-a783-48a3-abb9-305b1ece1efc None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:54.905381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9893354d-a783-48a3-abb9-305b1ece1efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:54.948452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c2df6-704d-427b-9b36-09e53c9751c5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:54.974805 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 447/865] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:54.975865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893354d-a783-48a3-abb9-305b1ece1efc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:54.991610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c980c59-c86f-4960-b025-67ae0dd9d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:54.993427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980c59-c86f-4960-b025-67ae0dd9d20d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:54.994382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980c59-c86f-4960-b025-67ae0dd9d20d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:54.995587 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980c59-c86f-4960-b025-67ae0dd9d20d None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:54.997846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c980c59-c86f-4960-b025-67ae0dd9d20d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:54.998713 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c980c59-c86f-4960-b025-67ae0dd9d20d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:55.003048 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c980c59-c86f-4960-b025-67ae0dd9d20d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:55.023106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 419/866] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:55.023685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c980c59-c86f-4960-b025-67ae0dd9d20d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:55.089550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893354d-a783-48a3-abb9-305b1ece1efc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:55.124793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662f900-6b7c-4397-bbd2-de2f57444f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:55.125724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662f900-6b7c-4397-bbd2-de2f57444f1f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:55.126009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662f900-6b7c-4397-bbd2-de2f57444f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:55.126294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662f900-6b7c-4397-bbd2-de2f57444f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:55.129603 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c980c59-c86f-4960-b025-67ae0dd9d20d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:55.136204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662f900-6b7c-4397-bbd2-de2f57444f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:55.137680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662f900-6b7c-4397-bbd2-de2f57444f1f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:55.154703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-3662f900-6b7c-4397-bbd2-de2f57444f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:55.156214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 448/867] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:55.157951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662f900-6b7c-4397-bbd2-de2f57444f1f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:55.174436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4682-cc74-47cf-8f1a-ed117ee3fb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:55.175406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4682-cc74-47cf-8f1a-ed117ee3fb62 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:55.175937 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4682-cc74-47cf-8f1a-ed117ee3fb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:55.176379 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4682-cc74-47cf-8f1a-ed117ee3fb62 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:55.177153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d4682-cc74-47cf-8f1a-ed117ee3fb62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:55.178585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d4682-cc74-47cf-8f1a-ed117ee3fb62 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:55.253796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662f900-6b7c-4397-bbd2-de2f57444f1f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:55.268989 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 420/868] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:06:55 2022] POST /identity/v3/services => generated 269 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:55.268989 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4682-cc74-47cf-8f1a-ed117ee3fb62 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:55.297868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0e8f1-9609-4d1c-ba43-c8453988c8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:55.298478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e8f1-9609-4d1c-ba43-c8453988c8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:55.298764 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e8f1-9609-4d1c-ba43-c8453988c8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:55.299042 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e8f1-9609-4d1c-ba43-c8453988c8c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:55.299917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0e8f1-9609-4d1c-ba43-c8453988c8c2 None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=e84a4f86f4c54625a22cfdcbc08da73b) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:55.300236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0e8f1-9609-4d1c-ba43-c8453988c8c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:55.301789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0e8f1-9609-4d1c-ba43-c8453988c8c2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:55.316165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 449/869] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:55 2022] GET /identity/v3/role_assignments?user.id=e84a4f86f4c54625a22cfdcbc08da73b&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:55.316165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767fbc4-12a0-4d4b-9802-a4b548a05a90 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:55.316165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767fbc4-12a0-4d4b-9802-a4b548a05a90 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:55.316165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767fbc4-12a0-4d4b-9802-a4b548a05a90 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:55.324369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 450/870] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:55.324369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eed98-6d96-4bb6-8ebe-87e82e52c76f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:55.324369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eed98-6d96-4bb6-8ebe-87e82e52c76f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:55.324573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eed98-6d96-4bb6-8ebe-87e82e52c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:55.345639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ad5eed98-6d96-4bb6-8ebe-87e82e52c76f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:55.347117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ad5eed98-6d96-4bb6-8ebe-87e82e52c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:55.386482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4682-cc74-47cf-8f1a-ed117ee3fb62 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:55.426522 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2ef85-259c-4044-88ed-fe7a44fc8210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:55.432991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 451/871] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:55 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:55.433210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2ef85-259c-4044-88ed-fe7a44fc8210 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:55.433210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2ef85-259c-4044-88ed-fe7a44fc8210 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:55.433210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2ef85-259c-4044-88ed-fe7a44fc8210 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:55.433210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2ef85-259c-4044-88ed-fe7a44fc8210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:55.433210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2ef85-259c-4044-88ed-fe7a44fc8210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:55.433210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2ef85-259c-4044-88ed-fe7a44fc8210 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:55.455653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 421/872] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:55.456700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eed98-6d96-4bb6-8ebe-87e82e52c76f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:55.459236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2ef85-259c-4044-88ed-fe7a44fc8210 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:55.565759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eed98-6d96-4bb6-8ebe-87e82e52c76f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:55.588090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2ef85-259c-4044-88ed-fe7a44fc8210 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:55.602628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d6c80-c00d-4729-be7e-4d6d8b713ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:55.603303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d6c80-c00d-4729-be7e-4d6d8b713ef8 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:55.603587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d6c80-c00d-4729-be7e-4d6d8b713ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:55.603863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d6c80-c00d-4729-be7e-4d6d8b713ef8 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:55.604599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d6c80-c00d-4729-be7e-4d6d8b713ef8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:55.606009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d6c80-c00d-4729-be7e-4d6d8b713ef8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:55.625115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b083fe-01f2-4f02-ba15-2c50440d797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:55.625955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b083fe-01f2-4f02-ba15-2c50440d797b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:55.626333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b083fe-01f2-4f02-ba15-2c50440d797b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:55.626610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b083fe-01f2-4f02-ba15-2c50440d797b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:55.634897 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b083fe-01f2-4f02-ba15-2c50440d797b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:55.636372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b083fe-01f2-4f02-ba15-2c50440d797b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:55.650627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-84b083fe-01f2-4f02-ba15-2c50440d797b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:06:55.652025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 422/873] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:06:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:55.658362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b083fe-01f2-4f02-ba15-2c50440d797b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:55.691976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 452/874] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:06:55 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:06:55.782765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b083fe-01f2-4f02-ba15-2c50440d797b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:55.826927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5db4e-8de9-44d3-9a35-2c3341961db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:55.827516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5db4e-8de9-44d3-9a35-2c3341961db1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:55.827859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5db4e-8de9-44d3-9a35-2c3341961db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:55.828141 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5db4e-8de9-44d3-9a35-2c3341961db1 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:55.829059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5db4e-8de9-44d3-9a35-2c3341961db1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:55.829376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5db4e-8de9-44d3-9a35-2c3341961db1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:55.830861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5db4e-8de9-44d3-9a35-2c3341961db1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:55.844194 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 423/875] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:06:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:06:55.850258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d6c80-c00d-4729-be7e-4d6d8b713ef8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:55.959040 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d6c80-c00d-4729-be7e-4d6d8b713ef8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:55.995190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d66b47-decc-478c-8275-665ec5597353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:55.996174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66b47-decc-478c-8275-665ec5597353 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:55.996643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66b47-decc-478c-8275-665ec5597353 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:55.997138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66b47-decc-478c-8275-665ec5597353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:55.998175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d66b47-decc-478c-8275-665ec5597353 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=987dcad83b914b5894955dfe3e1f71ab) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:55.998667 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d66b47-decc-478c-8275-665ec5597353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:56.000401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d66b47-decc-478c-8275-665ec5597353 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:56.006955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 453/876] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:06:55 2022] GET /identity/v3/role_assignments?user.id=987dcad83b914b5894955dfe3e1f71ab&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:57.839598 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4a7e-e130-434a-a742-9e6775b2fa05 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:57.841059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4a7e-e130-434a-a742-9e6775b2fa05 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:57.841655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4a7e-e130-434a-a742-9e6775b2fa05 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:57.843526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 424/877] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:57.849812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b17a-aa9f-4fd9-b5af-defcf7e01945 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:57.850882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b17a-aa9f-4fd9-b5af-defcf7e01945 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:57.851360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b17a-aa9f-4fd9-b5af-defcf7e01945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:57.863632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a8d3-f154-4079-8a4b-f9e68f3a2952 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:57.863936 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a8d3-f154-4079-8a4b-f9e68f3a2952 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:57.864180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a8d3-f154-4079-8a4b-f9e68f3a2952 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:57.866271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 425/878] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:06:57.872657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-feb7b17a-aa9f-4fd9-b5af-defcf7e01945 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:57.874253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-feb7b17a-aa9f-4fd9-b5af-defcf7e01945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:57.875886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9716c2-f9a2-4eca-b96a-303e5553f257 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:57.876638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9716c2-f9a2-4eca-b96a-303e5553f257 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:57.877272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9716c2-f9a2-4eca-b96a-303e5553f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:57.903474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ad9716c2-f9a2-4eca-b96a-303e5553f257 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:57.905132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ad9716c2-f9a2-4eca-b96a-303e5553f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:57.970018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 454/879] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:57.986137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 426/880] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:57.996587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7b17a-aa9f-4fd9-b5af-defcf7e01945 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.012882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9716c2-f9a2-4eca-b96a-303e5553f257 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.123184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7b17a-aa9f-4fd9-b5af-defcf7e01945 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:58.127000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9716c2-f9a2-4eca-b96a-303e5553f257 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:58.163424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534044d-c64b-45ff-a86f-02122b7129cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:58.164710 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534044d-c64b-45ff-a86f-02122b7129cc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.165224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534044d-c64b-45ff-a86f-02122b7129cc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.165695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534044d-c64b-45ff-a86f-02122b7129cc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.170129 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79006d2-f1e8-430a-96db-ea9cc1818f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:58.171188 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79006d2-f1e8-430a-96db-ea9cc1818f65 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.171619 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79006d2-f1e8-430a-96db-ea9cc1818f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.172577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79006d2-f1e8-430a-96db-ea9cc1818f65 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.173424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79006d2-f1e8-430a-96db-ea9cc1818f65 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:58.174961 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79006d2-f1e8-430a-96db-ea9cc1818f65 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:58.184143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534044d-c64b-45ff-a86f-02122b7129cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:06:58.190234 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-b79006d2-f1e8-430a-96db-ea9cc1818f65 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 14:06:58.192083 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 427/881] 10.222.0.61 () {56 vars in 1132 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:58.193867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-2534044d-c64b-45ff-a86f-02122b7129cc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 14:06:58.198486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79006d2-f1e8-430a-96db-ea9cc1818f65 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.204657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 455/882] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Apr 12 14:06:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:58.205909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534044d-c64b-45ff-a86f-02122b7129cc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.308199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534044d-c64b-45ff-a86f-02122b7129cc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:58.311815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79006d2-f1e8-430a-96db-ea9cc1818f65 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:58.343666 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71d40f-da4f-4613-987c-6dd1639f6c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:58.344368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71d40f-da4f-4613-987c-6dd1639f6c8a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.344651 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71d40f-da4f-4613-987c-6dd1639f6c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.344926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71d40f-da4f-4613-987c-6dd1639f6c8a None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.345702 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71d40f-da4f-4613-987c-6dd1639f6c8a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:58.346009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71d40f-da4f-4613-987c-6dd1639f6c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:58.347368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71d40f-da4f-4613-987c-6dd1639f6c8a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:58.354333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5dff0-5a61-4efa-bd2d-454deb5fb96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:58.354991 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5dff0-5a61-4efa-bd2d-454deb5fb96f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.355270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5dff0-5a61-4efa-bd2d-454deb5fb96f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.355542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5dff0-5a61-4efa-bd2d-454deb5fb96f None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.360574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 456/883] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:58.360719 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5dff0-5a61-4efa-bd2d-454deb5fb96f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:58.360719 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5dff0-5a61-4efa-bd2d-454deb5fb96f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:58.360869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64db3f-1262-4895-b9c9-8322da87df00 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.360869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64db3f-1262-4895-b9c9-8322da87df00 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.361203 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5dff0-5a61-4efa-bd2d-454deb5fb96f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:58.361296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64db3f-1262-4895-b9c9-8322da87df00 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.361296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 457/884] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:58.361516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64db3f-1262-4895-b9c9-8322da87df00 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.366005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 428/885] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:58.367105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461ad53-c770-4f23-b1db-2341b71861df None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.367388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461ad53-c770-4f23-b1db-2341b71861df None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.367660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461ad53-c770-4f23-b1db-2341b71861df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.386566 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8461ad53-c770-4f23-b1db-2341b71861df None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:58.387737 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8461ad53-c770-4f23-b1db-2341b71861df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:58.459061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 429/886] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:58.459913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461ad53-c770-4f23-b1db-2341b71861df None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.475834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64db3f-1262-4895-b9c9-8322da87df00 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:58.513120 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f37c1-d510-44df-994f-9390191722d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:58.513917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f37c1-d510-44df-994f-9390191722d3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.514200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f37c1-d510-44df-994f-9390191722d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.514475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f37c1-d510-44df-994f-9390191722d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.525475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f37c1-d510-44df-994f-9390191722d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:58.526907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f37c1-d510-44df-994f-9390191722d3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:58.542778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-d92f37c1-d510-44df-994f-9390191722d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:06:58.544229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 458/887] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:06:58.544895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f37c1-d510-44df-994f-9390191722d3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.556129 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461ad53-c770-4f23-b1db-2341b71861df None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:58.589988 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dc5df-4ac4-4b67-b28a-6420113c2876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:58.590576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dc5df-4ac4-4b67-b28a-6420113c2876 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.590860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dc5df-4ac4-4b67-b28a-6420113c2876 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.591135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dc5df-4ac4-4b67-b28a-6420113c2876 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.591860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dc5df-4ac4-4b67-b28a-6420113c2876 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:58.592166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dc5df-4ac4-4b67-b28a-6420113c2876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:58.593579 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dc5df-4ac4-4b67-b28a-6420113c2876 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:58.598526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 430/888] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:58.599743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75220c2-1dfb-4a54-b455-008a0fa4bd6d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.600029 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75220c2-1dfb-4a54-b455-008a0fa4bd6d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.600388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75220c2-1dfb-4a54-b455-008a0fa4bd6d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.603911 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 431/889] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:06:58.603911 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75220c2-1dfb-4a54-b455-008a0fa4bd6d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.644561 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f37c1-d510-44df-994f-9390191722d3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:58.677299 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43202814-5d46-49ea-9bd9-58295e0aa2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:58.678102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202814-5d46-49ea-9bd9-58295e0aa2fe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.678389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202814-5d46-49ea-9bd9-58295e0aa2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.678665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202814-5d46-49ea-9bd9-58295e0aa2fe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.679316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43202814-5d46-49ea-9bd9-58295e0aa2fe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:58.680684 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43202814-5d46-49ea-9bd9-58295e0aa2fe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:58.692251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-43202814-5d46-49ea-9bd9-58295e0aa2fe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 14:06:58.693617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 459/890] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:58.694211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43202814-5d46-49ea-9bd9-58295e0aa2fe None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.706975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75220c2-1dfb-4a54-b455-008a0fa4bd6d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:58.740015 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ea5a4-d4e7-466b-9c6e-b80654861866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:58.740663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ea5a4-d4e7-466b-9c6e-b80654861866 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.740941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ea5a4-d4e7-466b-9c6e-b80654861866 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.741239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ea5a4-d4e7-466b-9c6e-b80654861866 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.741947 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ea5a4-d4e7-466b-9c6e-b80654861866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:58.742249 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ea5a4-d4e7-466b-9c6e-b80654861866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:58.743633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ea5a4-d4e7-466b-9c6e-b80654861866 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:58.755239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 432/891] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:58.756528 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c39d32-ba47-4171-acf9-c9e407ed7da9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.756823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c39d32-ba47-4171-acf9-c9e407ed7da9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.757134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c39d32-ba47-4171-acf9-c9e407ed7da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.772884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-46c39d32-ba47-4171-acf9-c9e407ed7da9 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:06:58.774104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-46c39d32-ba47-4171-acf9-c9e407ed7da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:06:58.792519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43202814-5d46-49ea-9bd9-58295e0aa2fe None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:58.825639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07e5f9-237e-4fb8-a736-99e39b691377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:58.826298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07e5f9-237e-4fb8-a736-99e39b691377 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.826592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07e5f9-237e-4fb8-a736-99e39b691377 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.826865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07e5f9-237e-4fb8-a736-99e39b691377 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.827650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07e5f9-237e-4fb8-a736-99e39b691377 None admin] RBAC: Adding query filter params (interface=public, service_id=13757523a1f6449f91d4a54436314008, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:58.827968 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07e5f9-237e-4fb8-a736-99e39b691377 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:58.829600 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07e5f9-237e-4fb8-a736-99e39b691377 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:58.834452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 460/892] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/endpoints?service_id=13757523a1f6449f91d4a54436314008&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:58.835221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07e5f9-237e-4fb8-a736-99e39b691377 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.841289 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 433/893] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:06:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:06:58.841998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c39d32-ba47-4171-acf9-c9e407ed7da9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.935826 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07e5f9-237e-4fb8-a736-99e39b691377 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:58.938409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c39d32-ba47-4171-acf9-c9e407ed7da9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:58.969544 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02f560-ae22-4af7-92fd-f1010bff3746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:58.970515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02f560-ae22-4af7-92fd-f1010bff3746 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.971063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02f560-ae22-4af7-92fd-f1010bff3746 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.971346 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02f560-ae22-4af7-92fd-f1010bff3746 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.972064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02f560-ae22-4af7-92fd-f1010bff3746 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:58.972377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02f560-ae22-4af7-92fd-f1010bff3746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:58.973322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533cbdc-3847-4e2e-9251-a8f3947817ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:58.973804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02f560-ae22-4af7-92fd-f1010bff3746 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:58.974470 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533cbdc-3847-4e2e-9251-a8f3947817ad None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:58.974765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533cbdc-3847-4e2e-9251-a8f3947817ad None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:58.975042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533cbdc-3847-4e2e-9251-a8f3947817ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:58.978608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 461/894] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:58.979393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02f560-ae22-4af7-92fd-f1010bff3746 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:58.982353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533cbdc-3847-4e2e-9251-a8f3947817ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:58.984051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533cbdc-3847-4e2e-9251-a8f3947817ad None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:58.998331 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-f533cbdc-3847-4e2e-9251-a8f3947817ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 14:06:58.999520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 434/895] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:59.000927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533cbdc-3847-4e2e-9251-a8f3947817ad None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:59.082869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02f560-ae22-4af7-92fd-f1010bff3746 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:59.095503 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533cbdc-3847-4e2e-9251-a8f3947817ad None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:59.114820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313825d5-7bf4-4882-b532-32df22231cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:59.115489 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313825d5-7bf4-4882-b532-32df22231cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:59.115777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313825d5-7bf4-4882-b532-32df22231cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:59.116056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313825d5-7bf4-4882-b532-32df22231cd5 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:59.116740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313825d5-7bf4-4882-b532-32df22231cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:59.118167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313825d5-7bf4-4882-b532-32df22231cd5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:59.123823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 462/896] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/services => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:06:59.124529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313825d5-7bf4-4882-b532-32df22231cd5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:59.127931 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de225f-2d4f-4bbd-a714-a72f6512e45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:59.128753 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de225f-2d4f-4bbd-a714-a72f6512e45e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:59.129063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de225f-2d4f-4bbd-a714-a72f6512e45e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:59.129346 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de225f-2d4f-4bbd-a714-a72f6512e45e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:59.130017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de225f-2d4f-4bbd-a714-a72f6512e45e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:59.131449 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de225f-2d4f-4bbd-a714-a72f6512e45e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:59.143864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-95de225f-2d4f-4bbd-a714-a72f6512e45e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 14:06:59.145328 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 435/897] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Apr 12 14:06:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:06:59.145964 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de225f-2d4f-4bbd-a714-a72f6512e45e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:59.230959 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313825d5-7bf4-4882-b532-32df22231cd5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:59.261484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de225f-2d4f-4bbd-a714-a72f6512e45e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:59.271540 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87454e4e-1d65-4d79-8f33-c762645d1ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:59.272226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454e4e-1d65-4d79-8f33-c762645d1ada None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:59.272513 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454e4e-1d65-4d79-8f33-c762645d1ada None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:59.272800 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87454e4e-1d65-4d79-8f33-c762645d1ada None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:59.273567 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87454e4e-1d65-4d79-8f33-c762645d1ada None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:59.273880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87454e4e-1d65-4d79-8f33-c762645d1ada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:59.275423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87454e4e-1d65-4d79-8f33-c762645d1ada None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:59.288232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 463/898] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:06:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:59.289140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87454e4e-1d65-4d79-8f33-c762645d1ada None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:59.306543 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ba260-f167-4576-922b-381ee4aeb864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:59.307241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba260-f167-4576-922b-381ee4aeb864 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:59.307514 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba260-f167-4576-922b-381ee4aeb864 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:59.307784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba260-f167-4576-922b-381ee4aeb864 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:59.308635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ba260-f167-4576-922b-381ee4aeb864 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:59.308944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ba260-f167-4576-922b-381ee4aeb864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:59.310442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ba260-f167-4576-922b-381ee4aeb864 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:59.334621 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 436/899] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Apr 12 14:06:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:59.334621 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ba260-f167-4576-922b-381ee4aeb864 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:59.403804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87454e4e-1d65-4d79-8f33-c762645d1ada None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:59.432841 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ba260-f167-4576-922b-381ee4aeb864 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:59.440467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632d0e8-dd27-48fd-ae3e-80cd7489f822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:59.441404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632d0e8-dd27-48fd-ae3e-80cd7489f822 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:59.441832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632d0e8-dd27-48fd-ae3e-80cd7489f822 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:59.442249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632d0e8-dd27-48fd-ae3e-80cd7489f822 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:59.443110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632d0e8-dd27-48fd-ae3e-80cd7489f822 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:59.443571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632d0e8-dd27-48fd-ae3e-80cd7489f822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:59.445437 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632d0e8-dd27-48fd-ae3e-80cd7489f822 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:59.455482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 464/900] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Apr 12 14:06:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:59.456573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632d0e8-dd27-48fd-ae3e-80cd7489f822 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:59.468683 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81807f6-7fcd-43fb-ba4d-bd6fdd72f744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:59.470112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81807f6-7fcd-43fb-ba4d-bd6fdd72f744 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:59.470409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81807f6-7fcd-43fb-ba4d-bd6fdd72f744 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:59.470688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81807f6-7fcd-43fb-ba4d-bd6fdd72f744 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:59.471486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81807f6-7fcd-43fb-ba4d-bd6fdd72f744 None admin] RBAC: Adding query filter params (interface=public, service_id=900fbe922f764a8abdb45d48c9dcc39b, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:59.471799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81807f6-7fcd-43fb-ba4d-bd6fdd72f744 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:59.473322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81807f6-7fcd-43fb-ba4d-bd6fdd72f744 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:59.478929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 437/901] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Apr 12 14:06:59 2022] GET /identity/v3/endpoints?service_id=900fbe922f764a8abdb45d48c9dcc39b&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:59.479882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81807f6-7fcd-43fb-ba4d-bd6fdd72f744 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:59.565528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632d0e8-dd27-48fd-ae3e-80cd7489f822 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:59.588882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81807f6-7fcd-43fb-ba4d-bd6fdd72f744 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:59.609921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63c22b-7771-4d53-829d-a022323c6607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:59.610580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63c22b-7771-4d53-829d-a022323c6607 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:59.610859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63c22b-7771-4d53-829d-a022323c6607 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:59.611195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63c22b-7771-4d53-829d-a022323c6607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:59.622460 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64747b-10a4-4600-ae2f-620e2abbb57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:59.623114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64747b-10a4-4600-ae2f-620e2abbb57f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:59.623397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64747b-10a4-4600-ae2f-620e2abbb57f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:59.623671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64747b-10a4-4600-ae2f-620e2abbb57f None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:59.624367 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64747b-10a4-4600-ae2f-620e2abbb57f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:06:59.624671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64747b-10a4-4600-ae2f-620e2abbb57f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:59.626404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64747b-10a4-4600-ae2f-620e2abbb57f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:59.641372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 438/902] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Apr 12 14:06:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:06:59.641372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64747b-10a4-4600-ae2f-620e2abbb57f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:59.689291 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63c22b-7771-4d53-829d-a022323c6607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:59.690863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63c22b-7771-4d53-829d-a022323c6607 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:59.780494 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64747b-10a4-4600-ae2f-620e2abbb57f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:59.799369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 465/903] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:06:59 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:06:59.805434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63c22b-7771-4d53-829d-a022323c6607 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:06:59.823397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d980e4-1eab-4e5b-b5c7-3edea280b413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:59.824415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d980e4-1eab-4e5b-b5c7-3edea280b413 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:59.824920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d980e4-1eab-4e5b-b5c7-3edea280b413 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:59.825420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d980e4-1eab-4e5b-b5c7-3edea280b413 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:59.826302 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d980e4-1eab-4e5b-b5c7-3edea280b413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:59.827908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d980e4-1eab-4e5b-b5c7-3edea280b413 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:06:59.834975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 439/904] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Apr 12 14:06:59 2022] GET /identity/v3/services => generated 1268 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:06:59.929293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63c22b-7771-4d53-829d-a022323c6607 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:06:59.967803 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eee11d-12cf-44ca-a508-49f0cd5f98bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:06:59.969169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eee11d-12cf-44ca-a508-49f0cd5f98bc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:06:59.969477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eee11d-12cf-44ca-a508-49f0cd5f98bc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:06:59.969815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eee11d-12cf-44ca-a508-49f0cd5f98bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:06:59.981467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eee11d-12cf-44ca-a508-49f0cd5f98bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:06:59.982955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eee11d-12cf-44ca-a508-49f0cd5f98bc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:00.003085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-c9eee11d-12cf-44ca-a508-49f0cd5f98bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:00.004810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 466/905] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:00.010395 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d980e4-1eab-4e5b-b5c7-3edea280b413 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:00.114824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d980e4-1eab-4e5b-b5c7-3edea280b413 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:00.149535 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124bbf-b1c0-4b53-aeab-d3628d98750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:00.150202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124bbf-b1c0-4b53-aeab-d3628d98750e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:00.150484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124bbf-b1c0-4b53-aeab-d3628d98750e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:00.150758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124bbf-b1c0-4b53-aeab-d3628d98750e None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:00.151478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124bbf-b1c0-4b53-aeab-d3628d98750e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:00.151788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124bbf-b1c0-4b53-aeab-d3628d98750e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:00.153192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124bbf-b1c0-4b53-aeab-d3628d98750e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:00.165821 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 440/906] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:00.171618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eee11d-12cf-44ca-a508-49f0cd5f98bc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:00.275563 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eee11d-12cf-44ca-a508-49f0cd5f98bc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:00.312310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed552162-4cc2-41d6-a575-6b39f7759737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:00.313664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed552162-4cc2-41d6-a575-6b39f7759737 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:00.313946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed552162-4cc2-41d6-a575-6b39f7759737 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:00.314191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed552162-4cc2-41d6-a575-6b39f7759737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:00.321601 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed552162-4cc2-41d6-a575-6b39f7759737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:00.323044 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed552162-4cc2-41d6-a575-6b39f7759737 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:00.336320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-ed552162-4cc2-41d6-a575-6b39f7759737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:07:00.337905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 467/907] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:00.343572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124bbf-b1c0-4b53-aeab-d3628d98750e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:00.445501 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124bbf-b1c0-4b53-aeab-d3628d98750e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:00.482394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ad7ca-9855-4be8-bf17-a4e0ebc713ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:00.483061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ad7ca-9855-4be8-bf17-a4e0ebc713ed None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:00.483339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ad7ca-9855-4be8-bf17-a4e0ebc713ed None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:00.483612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ad7ca-9855-4be8-bf17-a4e0ebc713ed None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:00.484468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ad7ca-9855-4be8-bf17-a4e0ebc713ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:00.484798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ad7ca-9855-4be8-bf17-a4e0ebc713ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:00.486319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ad7ca-9855-4be8-bf17-a4e0ebc713ed None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:00.498845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 441/908] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:00.505592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed552162-4cc2-41d6-a575-6b39f7759737 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:00.606504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed552162-4cc2-41d6-a575-6b39f7759737 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:00.641819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eeccce-28ed-438b-908b-b01d39dd05f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:00.642480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeccce-28ed-438b-908b-b01d39dd05f9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:00.642767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeccce-28ed-438b-908b-b01d39dd05f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:00.643047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeccce-28ed-438b-908b-b01d39dd05f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:00.643877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eeccce-28ed-438b-908b-b01d39dd05f9 None admin] RBAC: Adding query filter params (role.id=ced9d7828d0e4de4b81ab8d0445331ea, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=e84a4f86f4c54625a22cfdcbc08da73b) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:00.644197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eeccce-28ed-438b-908b-b01d39dd05f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:00.645653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eeccce-28ed-438b-908b-b01d39dd05f9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:00.651608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 468/909] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:07:00 2022] GET /identity/v3/role_assignments?user.id=e84a4f86f4c54625a22cfdcbc08da73b&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=ced9d7828d0e4de4b81ab8d0445331ea => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:01.516318 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261b253-df8e-4c68-b379-c59dec4aec7d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:01.516843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261b253-df8e-4c68-b379-c59dec4aec7d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:01.516843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261b253-df8e-4c68-b379-c59dec4aec7d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:01.518665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 442/910] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:01.524061 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ecc7-ffd3-4781-8efc-c5819bc3f4a8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:01.524534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ecc7-ffd3-4781-8efc-c5819bc3f4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:01.524613 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ecc7-ffd3-4781-8efc-c5819bc3f4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:01.542141 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-11c1ecc7-ffd3-4781-8efc-c5819bc3f4a8 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:01.543419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-11c1ecc7-ffd3-4781-8efc-c5819bc3f4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:01.617084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 469/911] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:01.637228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261b253-df8e-4c68-b379-c59dec4aec7d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:01.758006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261b253-df8e-4c68-b379-c59dec4aec7d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:01.792553 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cb70c-5f00-4439-83c1-3083b26e329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:01.793310 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cb70c-5f00-4439-83c1-3083b26e329c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:01.793593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cb70c-5f00-4439-83c1-3083b26e329c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:01.793871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cb70c-5f00-4439-83c1-3083b26e329c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:01.794525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cb70c-5f00-4439-83c1-3083b26e329c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:01.795901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cb70c-5f00-4439-83c1-3083b26e329c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:01.808407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-d47cb70c-5f00-4439-83c1-3083b26e329c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 14:07:01.815359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 443/912] 10.222.0.61 () {56 vars in 1132 bytes} [Tue Apr 12 14:07:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:01.816851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1ecc7-ffd3-4781-8efc-c5819bc3f4a8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:01.924838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1ecc7-ffd3-4781-8efc-c5819bc3f4a8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:01.960512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15745ab-25ba-4bc5-94d1-76c20a731c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:01.961214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15745ab-25ba-4bc5-94d1-76c20a731c5f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:01.961498 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15745ab-25ba-4bc5-94d1-76c20a731c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:01.961778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15745ab-25ba-4bc5-94d1-76c20a731c5f None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:01.962492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15745ab-25ba-4bc5-94d1-76c20a731c5f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:01.962802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15745ab-25ba-4bc5-94d1-76c20a731c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:01.964178 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15745ab-25ba-4bc5-94d1-76c20a731c5f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:01.973371 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 470/913] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Apr 12 14:07:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:01.975213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cb70c-5f00-4439-83c1-3083b26e329c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:02.070993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198a419-307f-4d01-828d-6c89c7cdf43e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:02.071285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198a419-307f-4d01-828d-6c89c7cdf43e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:02.071468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198a419-307f-4d01-828d-6c89c7cdf43e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:02.073000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 471/914] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:07:02.078659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b16008-d7b1-4b4c-8238-0c1973da61fd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:02.078908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b16008-d7b1-4b4c-8238-0c1973da61fd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:02.079217 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b16008-d7b1-4b4c-8238-0c1973da61fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:02.088055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cb70c-5f00-4439-83c1-3083b26e329c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:02.097984 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-79b16008-d7b1-4b4c-8238-0c1973da61fd None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:02.099261 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-79b16008-d7b1-4b4c-8238-0c1973da61fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:02.126077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18417a-d8ab-4568-9632-0760b0cc6b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:02.126933 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18417a-d8ab-4568-9632-0760b0cc6b34 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:02.127262 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18417a-d8ab-4568-9632-0760b0cc6b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:02.127603 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18417a-d8ab-4568-9632-0760b0cc6b34 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:02.128386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18417a-d8ab-4568-9632-0760b0cc6b34 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:02.128740 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18417a-d8ab-4568-9632-0760b0cc6b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:02.130243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18417a-d8ab-4568-9632-0760b0cc6b34 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:02.135926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 444/915] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Apr 12 14:07:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:02.142148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18417a-d8ab-4568-9632-0760b0cc6b34 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:02.172952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 472/916] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:02.197915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b16008-d7b1-4b4c-8238-0c1973da61fd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:02.265836 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18417a-d8ab-4568-9632-0760b0cc6b34 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:02.300920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b16008-d7b1-4b4c-8238-0c1973da61fd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:02.310725 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfa204-a4ad-44bf-a55b-463e9761a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:02.311623 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfa204-a4ad-44bf-a55b-463e9761a0e0 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:02.311912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfa204-a4ad-44bf-a55b-463e9761a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:02.312597 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfa204-a4ad-44bf-a55b-463e9761a0e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:02.313434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfa204-a4ad-44bf-a55b-463e9761a0e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:02.314803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfa204-a4ad-44bf-a55b-463e9761a0e0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:02.336030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52a99b-4582-49b4-8bbb-724ce0dca968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:02.336409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52a99b-4582-49b4-8bbb-724ce0dca968 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:02.336690 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52a99b-4582-49b4-8bbb-724ce0dca968 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:02.336981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52a99b-4582-49b4-8bbb-724ce0dca968 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:02.337711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52a99b-4582-49b4-8bbb-724ce0dca968 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:02.339063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52a99b-4582-49b4-8bbb-724ce0dca968 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:02.426306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 445/917] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Apr 12 14:07:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:07:02.427718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62b4d5-5a25-4ee0-8e63-b50cf9f2d660 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:02.428011 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62b4d5-5a25-4ee0-8e63-b50cf9f2d660 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:02.428291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62b4d5-5a25-4ee0-8e63-b50cf9f2d660 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:02.439537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 473/918] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:07:02 2022] POST /identity/v3/services => generated 241 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:07:02.439757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 446/919] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:02.446779 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0df65-fd43-4720-b40a-ddea33ed0b9b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:02.447344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0df65-fd43-4720-b40a-ddea33ed0b9b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:02.447777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0df65-fd43-4720-b40a-ddea33ed0b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:02.468030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-02d0df65-fd43-4720-b40a-ddea33ed0b9b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:02.469771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-02d0df65-fd43-4720-b40a-ddea33ed0b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:02.558202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 474/920] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:02.585541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62b4d5-5a25-4ee0-8e63-b50cf9f2d660 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:02.709826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62b4d5-5a25-4ee0-8e63-b50cf9f2d660 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:02.745389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b6691-847e-4b63-8b59-625dc6ea8462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:02.746192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b6691-847e-4b63-8b59-625dc6ea8462 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:02.746473 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b6691-847e-4b63-8b59-625dc6ea8462 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:02.746749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b6691-847e-4b63-8b59-625dc6ea8462 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:02.747412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b6691-847e-4b63-8b59-625dc6ea8462 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:02.748786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b6691-847e-4b63-8b59-625dc6ea8462 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:02.760805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-3a1b6691-847e-4b63-8b59-625dc6ea8462 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 14:07:02.762416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 447/921] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:07:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:02.768734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0df65-fd43-4720-b40a-ddea33ed0b9b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:02.876185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0df65-fd43-4720-b40a-ddea33ed0b9b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:02.912291 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d060e-2c18-4753-8c94-837389293158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:02.912998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d060e-2c18-4753-8c94-837389293158 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:02.913295 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d060e-2c18-4753-8c94-837389293158 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:02.913575 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d060e-2c18-4753-8c94-837389293158 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:02.914303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d060e-2c18-4753-8c94-837389293158 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:02.914679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d060e-2c18-4753-8c94-837389293158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:02.916217 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d060e-2c18-4753-8c94-837389293158 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:02.922347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 475/922] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:07:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:02.927939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b6691-847e-4b63-8b59-625dc6ea8462 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:03.039240 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b6691-847e-4b63-8b59-625dc6ea8462 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:03.052196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeb4c1-eb8f-4ece-89e6-d022dd20ac01 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:03.052489 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeb4c1-eb8f-4ece-89e6-d022dd20ac01 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:03.052748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeb4c1-eb8f-4ece-89e6-d022dd20ac01 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:03.058175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 476/923] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:07:03.059868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a2ec2-5655-47b5-ab08-b5dfc7286482 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:03.060223 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a2ec2-5655-47b5-ab08-b5dfc7286482 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:03.060506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a2ec2-5655-47b5-ab08-b5dfc7286482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:03.077643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-da2a2ec2-5655-47b5-ab08-b5dfc7286482 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:03.079528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-da2a2ec2-5655-47b5-ab08-b5dfc7286482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:03.079803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33186b-925d-4cbe-862c-85ea03ccffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:03.080702 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33186b-925d-4cbe-862c-85ea03ccffbd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:03.081067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33186b-925d-4cbe-862c-85ea03ccffbd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:03.081393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33186b-925d-4cbe-862c-85ea03ccffbd None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:03.082325 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33186b-925d-4cbe-862c-85ea03ccffbd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:03.082644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33186b-925d-4cbe-862c-85ea03ccffbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:03.084895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33186b-925d-4cbe-862c-85ea03ccffbd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:03.090507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 448/924] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Apr 12 14:07:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:03.097046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33186b-925d-4cbe-862c-85ea03ccffbd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:03.161095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 477/925] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:03.175664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a2ec2-5655-47b5-ab08-b5dfc7286482 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:03.201695 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33186b-925d-4cbe-862c-85ea03ccffbd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:03.241665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccca8a8-9721-4c92-8775-61c15c72b0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:03.242458 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccca8a8-9721-4c92-8775-61c15c72b0fd None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:03.245441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccca8a8-9721-4c92-8775-61c15c72b0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:03.245441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccca8a8-9721-4c92-8775-61c15c72b0fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:03.245441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccca8a8-9721-4c92-8775-61c15c72b0fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:03.245441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccca8a8-9721-4c92-8775-61c15c72b0fd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:03.279897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a2ec2-5655-47b5-ab08-b5dfc7286482 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:03.314205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d90fb-789a-47a7-9b80-90ebeb430fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:03.315057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d90fb-789a-47a7-9b80-90ebeb430fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:03.315338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d90fb-789a-47a7-9b80-90ebeb430fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:03.315607 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d90fb-789a-47a7-9b80-90ebeb430fa4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:03.326127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d90fb-789a-47a7-9b80-90ebeb430fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:07:03.334133 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-fe8d90fb-789a-47a7-9b80-90ebeb430fa4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 14:07:03.335351 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 478/926] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Apr 12 14:07:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:07:03.342789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d90fb-789a-47a7-9b80-90ebeb430fa4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:03.401216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 449/927] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Apr 12 14:07:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:07:03.475677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d90fb-789a-47a7-9b80-90ebeb430fa4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:03.521278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf1c17-1790-4a10-a340-26751fdb4fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:03.521957 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf1c17-1790-4a10-a340-26751fdb4fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:03.522233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf1c17-1790-4a10-a340-26751fdb4fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:03.522501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf1c17-1790-4a10-a340-26751fdb4fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:03.523253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf1c17-1790-4a10-a340-26751fdb4fa6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:03.523558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf1c17-1790-4a10-a340-26751fdb4fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:03.524994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf1c17-1790-4a10-a340-26751fdb4fa6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:03.535501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 479/928] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Apr 12 14:07:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:03.542865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccca8a8-9721-4c92-8775-61c15c72b0fd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:03.656636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccca8a8-9721-4c92-8775-61c15c72b0fd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:03.701906 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd6df6-bb24-400d-8d68-362bbd89d44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:03.703831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6df6-bb24-400d-8d68-362bbd89d44a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:03.704381 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6df6-bb24-400d-8d68-362bbd89d44a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:03.704867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6df6-bb24-400d-8d68-362bbd89d44a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:03.717128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd6df6-bb24-400d-8d68-362bbd89d44a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:03.719530 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd6df6-bb24-400d-8d68-362bbd89d44a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:03.739167 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-52fd6df6-bb24-400d-8d68-362bbd89d44a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:03.744625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 450/929] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:03.747478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf1c17-1790-4a10-a340-26751fdb4fa6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:03.855037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf1c17-1790-4a10-a340-26751fdb4fa6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:03.892489 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5150e15-909a-4a67-9de5-33568880f059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:03.893621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150e15-909a-4a67-9de5-33568880f059 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:03.894102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150e15-909a-4a67-9de5-33568880f059 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:03.894583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150e15-909a-4a67-9de5-33568880f059 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:03.895648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5150e15-909a-4a67-9de5-33568880f059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:03.896203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5150e15-909a-4a67-9de5-33568880f059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:03.897815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5150e15-909a-4a67-9de5-33568880f059 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:03.915665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 480/930] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:03.917351 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd6df6-bb24-400d-8d68-362bbd89d44a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:04.021995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd6df6-bb24-400d-8d68-362bbd89d44a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:04.062822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2fcf7-8f7c-44f7-b381-f1a808031b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:04.063763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2fcf7-8f7c-44f7-b381-f1a808031b26 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:04.064055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2fcf7-8f7c-44f7-b381-f1a808031b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:04.064334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2fcf7-8f7c-44f7-b381-f1a808031b26 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:04.074605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2fcf7-8f7c-44f7-b381-f1a808031b26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:04.076060 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2fcf7-8f7c-44f7-b381-f1a808031b26 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:04.090760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-19c2fcf7-8f7c-44f7-b381-f1a808031b26 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 14:07:04.092261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 451/931] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Apr 12 14:07:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:04.098869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5150e15-909a-4a67-9de5-33568880f059 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:04.208177 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5150e15-909a-4a67-9de5-33568880f059 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:04.244174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beec7e1-14c0-4b3e-bc1e-27a5f83b44d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:04.245214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beec7e1-14c0-4b3e-bc1e-27a5f83b44d1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:04.245658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beec7e1-14c0-4b3e-bc1e-27a5f83b44d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:04.246088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beec7e1-14c0-4b3e-bc1e-27a5f83b44d1 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:04.252286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beec7e1-14c0-4b3e-bc1e-27a5f83b44d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:04.252286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beec7e1-14c0-4b3e-bc1e-27a5f83b44d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:04.252286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beec7e1-14c0-4b3e-bc1e-27a5f83b44d1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:04.273431 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 481/932] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Apr 12 14:07:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:04.275014 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2fcf7-8f7c-44f7-b381-f1a808031b26 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:04.383725 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2fcf7-8f7c-44f7-b381-f1a808031b26 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:04.419135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc02e2-f273-47ac-b9ad-4801b601b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:04.419934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc02e2-f273-47ac-b9ad-4801b601b75f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:04.420219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc02e2-f273-47ac-b9ad-4801b601b75f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:04.420489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc02e2-f273-47ac-b9ad-4801b601b75f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:04.433654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc02e2-f273-47ac-b9ad-4801b601b75f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:04.435135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc02e2-f273-47ac-b9ad-4801b601b75f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:04.454273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-72fc02e2-f273-47ac-b9ad-4801b601b75f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:04.460301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 452/933] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:04.461799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beec7e1-14c0-4b3e-bc1e-27a5f83b44d1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:04.570982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beec7e1-14c0-4b3e-bc1e-27a5f83b44d1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:04.607924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778650b-7999-4b7d-a268-834046c1f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:04.608589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778650b-7999-4b7d-a268-834046c1f077 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:04.609471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778650b-7999-4b7d-a268-834046c1f077 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:04.609873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778650b-7999-4b7d-a268-834046c1f077 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:04.610707 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778650b-7999-4b7d-a268-834046c1f077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:04.611017 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778650b-7999-4b7d-a268-834046c1f077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:04.612376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778650b-7999-4b7d-a268-834046c1f077 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:04.629105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 482/934] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:04.631055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc02e2-f273-47ac-b9ad-4801b601b75f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:04.738869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc02e2-f273-47ac-b9ad-4801b601b75f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:04.773723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9c891-84fc-4094-a157-8272d8805f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:04.774522 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9c891-84fc-4094-a157-8272d8805f17 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:04.774800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9c891-84fc-4094-a157-8272d8805f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:04.775071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9c891-84fc-4094-a157-8272d8805f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:04.782306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9c891-84fc-4094-a157-8272d8805f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:04.783771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9c891-84fc-4094-a157-8272d8805f17 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:04.798461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-d1d9c891-84fc-4094-a157-8272d8805f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:07:04.804485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 453/935] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:07:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:04.805985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778650b-7999-4b7d-a268-834046c1f077 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:04.912010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778650b-7999-4b7d-a268-834046c1f077 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:04.923882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db24aa-a432-4923-a174-01e9c3b8b209 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:04.924272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db24aa-a432-4923-a174-01e9c3b8b209 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:04.924437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db24aa-a432-4923-a174-01e9c3b8b209 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:04.926086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 454/936] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:07:04.931140 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47509850-df62-4465-87f6-fde8c1271201 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:04.931428 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47509850-df62-4465-87f6-fde8c1271201 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:04.931706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47509850-df62-4465-87f6-fde8c1271201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:04.948641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832214bb-1d55-4e45-983f-99b84e97c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:04.949357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832214bb-1d55-4e45-983f-99b84e97c00b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:04.949638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832214bb-1d55-4e45-983f-99b84e97c00b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:04.949909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832214bb-1d55-4e45-983f-99b84e97c00b None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:04.950509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-47509850-df62-4465-87f6-fde8c1271201 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:04.950692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832214bb-1d55-4e45-983f-99b84e97c00b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:04.951003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832214bb-1d55-4e45-983f-99b84e97c00b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:04.951712 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-47509850-df62-4465-87f6-fde8c1271201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:04.952434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832214bb-1d55-4e45-983f-99b84e97c00b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:04.966562 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 483/937] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:07:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:04.968000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46a205-70bd-474c-8dc3-d8b2f258af84 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:04.968948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46a205-70bd-474c-8dc3-d8b2f258af84 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:04.969244 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46a205-70bd-474c-8dc3-d8b2f258af84 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:04.970619 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 484/938] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:04.974206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46a205-70bd-474c-8dc3-d8b2f258af84 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:05.025265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 455/939] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:05.026529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a906d-4d16-403e-a5e4-57b7bbe29ae1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:05.026820 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a906d-4d16-403e-a5e4-57b7bbe29ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:05.027093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a906d-4d16-403e-a5e4-57b7bbe29ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:05.052008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f84a906d-4d16-403e-a5e4-57b7bbe29ae1 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:05.053589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f84a906d-4d16-403e-a5e4-57b7bbe29ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:05.076388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46a205-70bd-474c-8dc3-d8b2f258af84 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:05.117187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cb835-61aa-4b82-a50a-afb43cfaf55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:05.118633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cb835-61aa-4b82-a50a-afb43cfaf55c None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:05.118918 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cb835-61aa-4b82-a50a-afb43cfaf55c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:05.119189 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cb835-61aa-4b82-a50a-afb43cfaf55c None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/e84a4f86f4c54625a22cfdcbc08da73b/roles/ced9d7828d0e4de4b81ab8d0445331ea` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:05.121403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5cb835-61aa-4b82-a50a-afb43cfaf55c None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=e84a4f86f4c54625a22cfdcbc08da73b, role_id=ced9d7828d0e4de4b81ab8d0445331ea)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:05.129052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 456/940] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:05.129218 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5cb835-61aa-4b82-a50a-afb43cfaf55c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:05.129319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a906d-4d16-403e-a5e4-57b7bbe29ae1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:05.207375 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 485/941] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:07:04 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/e84a4f86f4c54625a22cfdcbc08da73b/roles/ced9d7828d0e4de4b81ab8d0445331ea => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:07:05.208663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cb835-61aa-4b82-a50a-afb43cfaf55c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:05.257252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a906d-4d16-403e-a5e4-57b7bbe29ae1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:05.306728 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52592e97-d0dd-494a-8fcc-b5f6122a4f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:05.308001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52592e97-d0dd-494a-8fcc-b5f6122a4f7a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:05.308272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52592e97-d0dd-494a-8fcc-b5f6122a4f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:05.308542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52592e97-d0dd-494a-8fcc-b5f6122a4f7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:05.309296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52592e97-d0dd-494a-8fcc-b5f6122a4f7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:05.311017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52592e97-d0dd-494a-8fcc-b5f6122a4f7a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:05.328328 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-52592e97-d0dd-494a-8fcc-b5f6122a4f7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 14:07:05.330005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 457/942] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Apr 12 14:07:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:05.335960 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52592e97-d0dd-494a-8fcc-b5f6122a4f7a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:05.338337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cb835-61aa-4b82-a50a-afb43cfaf55c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:05.379364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df063cd-90fb-4afe-8c41-8301307dfa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:05.380597 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df063cd-90fb-4afe-8c41-8301307dfa1c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:05.381187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df063cd-90fb-4afe-8c41-8301307dfa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:05.381831 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df063cd-90fb-4afe-8c41-8301307dfa1c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:05.382779 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df063cd-90fb-4afe-8c41-8301307dfa1c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:05.384485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df063cd-90fb-4afe-8c41-8301307dfa1c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:05.397955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-7df063cd-90fb-4afe-8c41-8301307dfa1c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 14:07:05.399622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 486/943] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:07:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:05.407961 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df063cd-90fb-4afe-8c41-8301307dfa1c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:05.475456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52592e97-d0dd-494a-8fcc-b5f6122a4f7a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:05.512000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8b80-2419-4c44-8b73-7acaf95f3bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:05.512781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8b80-2419-4c44-8b73-7acaf95f3bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:05.513101 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8b80-2419-4c44-8b73-7acaf95f3bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:05.513376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8b80-2419-4c44-8b73-7acaf95f3bf0 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:05.514083 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f8b80-2419-4c44-8b73-7acaf95f3bf0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:05.514387 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f8b80-2419-4c44-8b73-7acaf95f3bf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:05.516402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f8b80-2419-4c44-8b73-7acaf95f3bf0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:05.521905 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 458/944] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Apr 12 14:07:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:05.529896 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8b80-2419-4c44-8b73-7acaf95f3bf0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:05.538988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df063cd-90fb-4afe-8c41-8301307dfa1c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:05.584983 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66568272-f36f-414b-a542-e3e8302f7824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:05.586082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568272-f36f-414b-a542-e3e8302f7824 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:05.586369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568272-f36f-414b-a542-e3e8302f7824 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:05.586650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568272-f36f-414b-a542-e3e8302f7824 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:05.587390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66568272-f36f-414b-a542-e3e8302f7824 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:05.587701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66568272-f36f-414b-a542-e3e8302f7824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:05.589825 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66568272-f36f-414b-a542-e3e8302f7824 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:05.598170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 487/945] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:07:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:05.604338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66568272-f36f-414b-a542-e3e8302f7824 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:05.652563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8b80-2419-4c44-8b73-7acaf95f3bf0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:05.694204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4a2a0-9d7d-4b2c-a62e-1dbd7ed891c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:05.695273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4a2a0-9d7d-4b2c-a62e-1dbd7ed891c2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:05.695935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4a2a0-9d7d-4b2c-a62e-1dbd7ed891c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:05.696272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4a2a0-9d7d-4b2c-a62e-1dbd7ed891c2 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:05.697108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4a2a0-9d7d-4b2c-a62e-1dbd7ed891c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:05.697484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4a2a0-9d7d-4b2c-a62e-1dbd7ed891c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:05.698908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4a2a0-9d7d-4b2c-a62e-1dbd7ed891c2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:05.712123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 459/946] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Apr 12 14:07:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:05.713207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4a2a0-9d7d-4b2c-a62e-1dbd7ed891c2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:05.728218 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66568272-f36f-414b-a542-e3e8302f7824 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:05.767521 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7ae0a-4aae-4e0e-8915-1dc4e99c0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:05.768195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7ae0a-4aae-4e0e-8915-1dc4e99c0da4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:05.768475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7ae0a-4aae-4e0e-8915-1dc4e99c0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:05.768751 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7ae0a-4aae-4e0e-8915-1dc4e99c0da4 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:05.769490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7ae0a-4aae-4e0e-8915-1dc4e99c0da4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:05.769796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7ae0a-4aae-4e0e-8915-1dc4e99c0da4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:05.771173 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7ae0a-4aae-4e0e-8915-1dc4e99c0da4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:05.785399 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 488/947] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:07:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:05.830859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4a2a0-9d7d-4b2c-a62e-1dbd7ed891c2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:05.869370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df85a76-7a62-47e6-b325-9c8365e7cd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:05.870041 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df85a76-7a62-47e6-b325-9c8365e7cd26 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:05.870322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df85a76-7a62-47e6-b325-9c8365e7cd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:05.870594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df85a76-7a62-47e6-b325-9c8365e7cd26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:05.871388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df85a76-7a62-47e6-b325-9c8365e7cd26 None admin] RBAC: Adding query filter params (interface=public, service_id=20b2eeef64244c948857981691d9bcc3, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:05.871696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df85a76-7a62-47e6-b325-9c8365e7cd26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:05.873116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df85a76-7a62-47e6-b325-9c8365e7cd26 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:05.880090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 460/948] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Apr 12 14:07:05 2022] GET /identity/v3/endpoints?service_id=20b2eeef64244c948857981691d9bcc3&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:05.886351 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7ae0a-4aae-4e0e-8915-1dc4e99c0da4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:05.985461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adddf6-016b-43b8-adf7-848ebe6a3a2d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:05.985759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adddf6-016b-43b8-adf7-848ebe6a3a2d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:05.985932 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adddf6-016b-43b8-adf7-848ebe6a3a2d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:05.987273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 461/949] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:05.994781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f44a5-47b3-44ab-bef5-48e158708806 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:05.995213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f44a5-47b3-44ab-bef5-48e158708806 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:05.995319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f44a5-47b3-44ab-bef5-48e158708806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:06.002997 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7ae0a-4aae-4e0e-8915-1dc4e99c0da4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:06.016326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e70f44a5-47b3-44ab-bef5-48e158708806 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:06.018661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e70f44a5-47b3-44ab-bef5-48e158708806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:06.038980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762435-94bc-4eda-8fbc-95bcdacb51ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:06.039653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762435-94bc-4eda-8fbc-95bcdacb51ff None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:06.039932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762435-94bc-4eda-8fbc-95bcdacb51ff None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:06.040375 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762435-94bc-4eda-8fbc-95bcdacb51ff None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:06.041099 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b762435-94bc-4eda-8fbc-95bcdacb51ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:06.042852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b762435-94bc-4eda-8fbc-95bcdacb51ff None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:06.060994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 489/950] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Apr 12 14:07:05 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:07:06.104176 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 462/951] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:06.129863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762435-94bc-4eda-8fbc-95bcdacb51ff None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:06.252374 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762435-94bc-4eda-8fbc-95bcdacb51ff None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:06.286354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c690d4f-d69f-4fef-827c-ebca1b07c90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:06.287033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690d4f-d69f-4fef-827c-ebca1b07c90b None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:06.287343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690d4f-d69f-4fef-827c-ebca1b07c90b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:06.287620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690d4f-d69f-4fef-827c-ebca1b07c90b None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:06.288369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c690d4f-d69f-4fef-827c-ebca1b07c90b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:06.290065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c690d4f-d69f-4fef-827c-ebca1b07c90b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:06.291449 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.common [None req-4c690d4f-d69f-4fef-827c-ebca1b07c90b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 12 14:07:06.350739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.sql.core [None req-4c690d4f-d69f-4fef-827c-ebca1b07c90b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 12 14:07:06.350739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 12 14:07:06.350739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [parameters: {'id': '594f2aa423fc42208dd5c88c7544cd79', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 12 14:07:06.350739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80175) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 14:07:06.357485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-4c690d4f-d69f-4fef-827c-ebca1b07c90b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 594f2aa423fc42208dd5c88c7544cd79.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 594f2aa423fc42208dd5c88c7544cd79. Apr 12 14:07:06.358931 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 490/952] 10.222.0.61 () {60 vars in 1140 bytes} [Tue Apr 12 14:07:06 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:06.365079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f44a5-47b3-44ab-bef5-48e158708806 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:06.473879 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f44a5-47b3-44ab-bef5-48e158708806 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:06.508310 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603526a0-e906-4a02-9324-9c8321019e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:06.509052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603526a0-e906-4a02-9324-9c8321019e7b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:06.509343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603526a0-e906-4a02-9324-9c8321019e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:06.509621 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603526a0-e906-4a02-9324-9c8321019e7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:06.517642 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603526a0-e906-4a02-9324-9c8321019e7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:06.519112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603526a0-e906-4a02-9324-9c8321019e7b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:06.533261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-603526a0-e906-4a02-9324-9c8321019e7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:07:06.535167 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 463/953] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:07:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:06.540833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c690d4f-d69f-4fef-827c-ebca1b07c90b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:06.649038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c690d4f-d69f-4fef-827c-ebca1b07c90b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:06.684999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442485df-866e-491f-8b5a-fd606230b8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:06.685688 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442485df-866e-491f-8b5a-fd606230b8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:06.685975 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442485df-866e-491f-8b5a-fd606230b8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:06.686250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442485df-866e-491f-8b5a-fd606230b8f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:06.687232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442485df-866e-491f-8b5a-fd606230b8f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:06.687638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442485df-866e-491f-8b5a-fd606230b8f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:06.689313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442485df-866e-491f-8b5a-fd606230b8f9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:06.716503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 491/954] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:07:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:07.606998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6659-144c-4267-aac5-d96c4aa852cb None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:07.607539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6659-144c-4267-aac5-d96c4aa852cb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:07.607539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6659-144c-4267-aac5-d96c4aa852cb None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:07.609895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 464/955] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:07.615716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a99405-b24a-485d-8f78-2150be069a88 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:07.616169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a99405-b24a-485d-8f78-2150be069a88 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:07.616350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a99405-b24a-485d-8f78-2150be069a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:07.634069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-84a99405-b24a-485d-8f78-2150be069a88 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:07.635604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-84a99405-b24a-485d-8f78-2150be069a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:07.715098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 492/956] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:07.739890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d6659-144c-4267-aac5-d96c4aa852cb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:07.845263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d6659-144c-4267-aac5-d96c4aa852cb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:07.881294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735f682-dd39-474f-bcd5-2ce844573a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:07.882485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f682-dd39-474f-bcd5-2ce844573a97 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:07.882971 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f682-dd39-474f-bcd5-2ce844573a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:07.883443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f682-dd39-474f-bcd5-2ce844573a97 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:07.896858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735f682-dd39-474f-bcd5-2ce844573a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:07:07.904917 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-7735f682-dd39-474f-bcd5-2ce844573a97 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 14:07:07.911745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 465/957] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Apr 12 14:07:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:07.914099 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a99405-b24a-485d-8f78-2150be069a88 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:08.020311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a99405-b24a-485d-8f78-2150be069a88 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:08.056043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b92d0c-a73d-4a3f-bf44-783d1700e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:08.056717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b92d0c-a73d-4a3f-bf44-783d1700e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:08.057021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b92d0c-a73d-4a3f-bf44-783d1700e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:08.057297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b92d0c-a73d-4a3f-bf44-783d1700e3b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:08.058044 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b92d0c-a73d-4a3f-bf44-783d1700e3b0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:08.058347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b92d0c-a73d-4a3f-bf44-783d1700e3b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:08.059709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b92d0c-a73d-4a3f-bf44-783d1700e3b0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:08.069474 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 493/958] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Apr 12 14:07:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:08.075592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735f682-dd39-474f-bcd5-2ce844573a97 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:08.183048 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735f682-dd39-474f-bcd5-2ce844573a97 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:08.220309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ff39e-3a82-4d24-98df-e317f5e79d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:08.221512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ff39e-3a82-4d24-98df-e317f5e79d00 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:08.222009 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ff39e-3a82-4d24-98df-e317f5e79d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:08.222474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ff39e-3a82-4d24-98df-e317f5e79d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:08.234608 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ff39e-3a82-4d24-98df-e317f5e79d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:08.236428 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ff39e-3a82-4d24-98df-e317f5e79d00 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:08.254300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-ce1ff39e-3a82-4d24-98df-e317f5e79d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:08.260498 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 466/959] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:08.262128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b92d0c-a73d-4a3f-bf44-783d1700e3b0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:08.307396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09924-faee-40da-b54c-f60c95fb0981 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:08.308002 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09924-faee-40da-b54c-f60c95fb0981 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:08.308447 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09924-faee-40da-b54c-f60c95fb0981 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:08.310942 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 467/960] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:07:08.316770 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b48a-c8d2-4364-9955-ee4a85d9600e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:08.317360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b48a-c8d2-4364-9955-ee4a85d9600e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:08.317848 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b48a-c8d2-4364-9955-ee4a85d9600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:08.335951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ebf4b48a-c8d2-4364-9955-ee4a85d9600e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:08.337475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ebf4b48a-c8d2-4364-9955-ee4a85d9600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:08.371734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b92d0c-a73d-4a3f-bf44-783d1700e3b0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:08.407435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a05068-7b3a-4df2-a231-7c83601a63b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:08.408459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05068-7b3a-4df2-a231-7c83601a63b1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:08.408885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05068-7b3a-4df2-a231-7c83601a63b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:08.409353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05068-7b3a-4df2-a231-7c83601a63b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:08.410304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a05068-7b3a-4df2-a231-7c83601a63b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:08.410823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a05068-7b3a-4df2-a231-7c83601a63b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:08.412419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a05068-7b3a-4df2-a231-7c83601a63b1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:08.417167 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 468/961] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:08.426350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 494/962] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:08.435175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4b48a-c8d2-4364-9955-ee4a85d9600e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:08.439128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a05068-7b3a-4df2-a231-7c83601a63b1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:08.537792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4b48a-c8d2-4364-9955-ee4a85d9600e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:08.548870 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a05068-7b3a-4df2-a231-7c83601a63b1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:08.571173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fe0de-1a6b-4406-bbee-cc80139647f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:08.571983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe0de-1a6b-4406-bbee-cc80139647f5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:08.572270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe0de-1a6b-4406-bbee-cc80139647f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:08.572542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe0de-1a6b-4406-bbee-cc80139647f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:08.580900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fe0de-1a6b-4406-bbee-cc80139647f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:08.582482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fe0de-1a6b-4406-bbee-cc80139647f5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:08.583555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df840fa7-053e-4e4e-9c23-1e9409e4316e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:08.584233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df840fa7-053e-4e4e-9c23-1e9409e4316e None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:08.584514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df840fa7-053e-4e4e-9c23-1e9409e4316e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:08.584789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df840fa7-053e-4e4e-9c23-1e9409e4316e None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:08.585544 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df840fa7-053e-4e4e-9c23-1e9409e4316e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:08.586928 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df840fa7-053e-4e4e-9c23-1e9409e4316e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:08.597840 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-8f6fe0de-1a6b-4406-bbee-cc80139647f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 14:07:08.611084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 469/963] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Apr 12 14:07:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:08.611084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae92c3-c245-4bb2-a015-9b0607eeeafd None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:08.611084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae92c3-c245-4bb2-a015-9b0607eeeafd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:08.611084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae92c3-c245-4bb2-a015-9b0607eeeafd None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:08.611084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 470/964] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:08.611084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae92c3-c245-4bb2-a015-9b0607eeeafd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:08.693247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 495/965] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:07:08 2022] POST /identity/v3/services => generated 242 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:07:08.695620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fc445-5c67-4f25-973b-d540c14838c1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:08.696127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fc445-5c67-4f25-973b-d540c14838c1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:08.696619 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fc445-5c67-4f25-973b-d540c14838c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:08.721186 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7d2fc445-5c67-4f25-973b-d540c14838c1 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:08.722857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7d2fc445-5c67-4f25-973b-d540c14838c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:08.727276 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae92c3-c245-4bb2-a015-9b0607eeeafd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:08.767647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff7749-edc6-4b5c-9afa-97a6f89ac971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:08.768368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff7749-edc6-4b5c-9afa-97a6f89ac971 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:08.768647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff7749-edc6-4b5c-9afa-97a6f89ac971 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:08.768918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff7749-edc6-4b5c-9afa-97a6f89ac971 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:08.769797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff7749-edc6-4b5c-9afa-97a6f89ac971 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:08.770106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff7749-edc6-4b5c-9afa-97a6f89ac971 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:08.771581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff7749-edc6-4b5c-9afa-97a6f89ac971 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:08.797005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 471/966] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Apr 12 14:07:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:08.799577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff7749-edc6-4b5c-9afa-97a6f89ac971 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:08.817413 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 496/967] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:08.847223 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fc445-5c67-4f25-973b-d540c14838c1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:08.933942 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff7749-edc6-4b5c-9afa-97a6f89ac971 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:08.975439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030323b-9b17-4954-9c8a-9935605332fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:08.976017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030323b-9b17-4954-9c8a-9935605332fc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:08.976305 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030323b-9b17-4954-9c8a-9935605332fc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:08.976579 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030323b-9b17-4954-9c8a-9935605332fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:08.977794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fc445-5c67-4f25-973b-d540c14838c1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:09.023497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b0ac5-6b3b-47c0-95e2-bbe796c354cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:09.024859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b0ac5-6b3b-47c0-95e2-bbe796c354cb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:09.025767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b0ac5-6b3b-47c0-95e2-bbe796c354cb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:09.026393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b0ac5-6b3b-47c0-95e2-bbe796c354cb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:09.027330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b0ac5-6b3b-47c0-95e2-bbe796c354cb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:09.029386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b0ac5-6b3b-47c0-95e2-bbe796c354cb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:09.045116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-f49b0ac5-6b3b-47c0-95e2-bbe796c354cb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 14:07:09.047741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 497/968] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Apr 12 14:07:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:07:09.048818 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030323b-9b17-4954-9c8a-9935605332fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:09.050525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030323b-9b17-4954-9c8a-9935605332fc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:09.053173 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b0ac5-6b3b-47c0-95e2-bbe796c354cb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:09.162743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 472/969] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:07:08 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:07:09.168571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030323b-9b17-4954-9c8a-9935605332fc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:09.179880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b0ac5-6b3b-47c0-95e2-bbe796c354cb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:09.215055 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c65f4-e3f8-477a-907d-c347d55eafc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:09.215720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c65f4-e3f8-477a-907d-c347d55eafc9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:09.215999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c65f4-e3f8-477a-907d-c347d55eafc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:09.216277 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c65f4-e3f8-477a-907d-c347d55eafc9 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:09.216993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c65f4-e3f8-477a-907d-c347d55eafc9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:09.217310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c65f4-e3f8-477a-907d-c347d55eafc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:09.219465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c65f4-e3f8-477a-907d-c347d55eafc9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:09.227837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 498/970] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Apr 12 14:07:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:09.229331 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafde86-e090-428e-a55f-720bb60a9930 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:09.229625 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafde86-e090-428e-a55f-720bb60a9930 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:09.229949 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafde86-e090-428e-a55f-720bb60a9930 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:09.235239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 499/971] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:09.235239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafde86-e090-428e-a55f-720bb60a9930 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:09.278368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030323b-9b17-4954-9c8a-9935605332fc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:09.315178 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba6b08-13ed-4ee0-9637-323d6b3d57c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:09.316072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba6b08-13ed-4ee0-9637-323d6b3d57c7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:09.316354 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba6b08-13ed-4ee0-9637-323d6b3d57c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:09.316622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba6b08-13ed-4ee0-9637-323d6b3d57c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:09.327706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba6b08-13ed-4ee0-9637-323d6b3d57c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:09.329971 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba6b08-13ed-4ee0-9637-323d6b3d57c7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:09.347306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafde86-e090-428e-a55f-720bb60a9930 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:09.348161 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-5bba6b08-13ed-4ee0-9637-323d6b3d57c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:09.349721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 473/972] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:07:09.350938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fbc5-1c14-48df-b116-3dacf9caf4b0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:09.351222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fbc5-1c14-48df-b116-3dacf9caf4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:09.351493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fbc5-1c14-48df-b116-3dacf9caf4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:09.368409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5988fbc5-1c14-48df-b116-3dacf9caf4b0 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:09.369615 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5988fbc5-1c14-48df-b116-3dacf9caf4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:09.387725 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613ba53-0c6c-4cdc-ae5b-d0b2800212a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:09.388448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613ba53-0c6c-4cdc-ae5b-d0b2800212a7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:09.388728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613ba53-0c6c-4cdc-ae5b-d0b2800212a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:09.389082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613ba53-0c6c-4cdc-ae5b-d0b2800212a7 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:09.390318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613ba53-0c6c-4cdc-ae5b-d0b2800212a7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:09.390646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613ba53-0c6c-4cdc-ae5b-d0b2800212a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:09.391999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613ba53-0c6c-4cdc-ae5b-d0b2800212a7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:09.396891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 500/973] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Apr 12 14:07:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:09.397699 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613ba53-0c6c-4cdc-ae5b-d0b2800212a7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:09.445984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 474/974] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:09.446813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988fbc5-1c14-48df-b116-3dacf9caf4b0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:09.520979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613ba53-0c6c-4cdc-ae5b-d0b2800212a7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:09.553105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988fbc5-1c14-48df-b116-3dacf9caf4b0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:09.558001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a2a77-c67d-467a-b77f-f190503f8b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:09.558685 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a2a77-c67d-467a-b77f-f190503f8b93 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:09.558968 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a2a77-c67d-467a-b77f-f190503f8b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:09.559243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a2a77-c67d-467a-b77f-f190503f8b93 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:09.559977 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a2a77-c67d-467a-b77f-f190503f8b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:09.560309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a2a77-c67d-467a-b77f-f190503f8b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:09.562472 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a2a77-c67d-467a-b77f-f190503f8b93 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:09.578906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 501/975] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:09.579745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a2a77-c67d-467a-b77f-f190503f8b93 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:09.597595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab5240-1315-48d4-873f-583b3eadf68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:09.598254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5240-1315-48d4-873f-583b3eadf68f None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:09.598534 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5240-1315-48d4-873f-583b3eadf68f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:09.598805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5240-1315-48d4-873f-583b3eadf68f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:09.599548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab5240-1315-48d4-873f-583b3eadf68f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:09.600919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab5240-1315-48d4-873f-583b3eadf68f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:09.669045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 475/976] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Apr 12 14:07:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:07:09.669045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab5240-1315-48d4-873f-583b3eadf68f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:09.708591 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a2a77-c67d-467a-b77f-f190503f8b93 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:09.755550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1be20-9d8f-4142-a864-15131e33afb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:09.756237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1be20-9d8f-4142-a864-15131e33afb7 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:09.756516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1be20-9d8f-4142-a864-15131e33afb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:09.756788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1be20-9d8f-4142-a864-15131e33afb7 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:09.757533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1be20-9d8f-4142-a864-15131e33afb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:09.759076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1be20-9d8f-4142-a864-15131e33afb7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:09.779095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab5240-1315-48d4-873f-583b3eadf68f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:09.794512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.sql.core [None req-6ca1be20-9d8f-4142-a864-15131e33afb7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 12 14:07:09.794512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 12 14:07:09.794512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [parameters: {'user_id': '7490f079fa0842299eb15f31a093b4f2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 12 14:07:09.794512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80175) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 14:07:09.802624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-6ca1be20-9d8f-4142-a864-15131e33afb7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 12 14:07:09.804341 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 502/977] 10.222.0.61 () {60 vars in 1131 bytes} [Tue Apr 12 14:07:09 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:09.813112 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1be20-9d8f-4142-a864-15131e33afb7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:09.821420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ae842-e215-4bad-b6c8-7edc9b09964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:09.822250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae842-e215-4bad-b6c8-7edc9b09964c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:09.822533 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae842-e215-4bad-b6c8-7edc9b09964c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:09.822810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae842-e215-4bad-b6c8-7edc9b09964c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:09.833147 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ae842-e215-4bad-b6c8-7edc9b09964c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:09.834916 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ae842-e215-4bad-b6c8-7edc9b09964c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:09.855556 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-3b7ae842-e215-4bad-b6c8-7edc9b09964c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:07:09.861007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 476/978] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:07:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:09.864903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ae842-e215-4bad-b6c8-7edc9b09964c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:09.971066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1be20-9d8f-4142-a864-15131e33afb7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:09.996348 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ae842-e215-4bad-b6c8-7edc9b09964c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:10.029376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54baca8-96ba-4a1c-933c-3edf9f7803cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:10.033055 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54baca8-96ba-4a1c-933c-3edf9f7803cc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:10.034021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54baca8-96ba-4a1c-933c-3edf9f7803cc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:10.034990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54baca8-96ba-4a1c-933c-3edf9f7803cc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:10.035977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab079-82c8-4400-b466-40459fb759d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:10.036636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab079-82c8-4400-b466-40459fb759d4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:10.036915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab079-82c8-4400-b466-40459fb759d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:10.037215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab079-82c8-4400-b466-40459fb759d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:10.038003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ab079-82c8-4400-b466-40459fb759d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:10.038309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ab079-82c8-4400-b466-40459fb759d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:10.039746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ab079-82c8-4400-b466-40459fb759d4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:10.051415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54baca8-96ba-4a1c-933c-3edf9f7803cc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:10.060002 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 477/979] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:07:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:10.060210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54baca8-96ba-4a1c-933c-3edf9f7803cc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:10.061711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab079-82c8-4400-b466-40459fb759d4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:10.081663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-c54baca8-96ba-4a1c-933c-3edf9f7803cc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 14:07:10.089752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 503/980] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:07:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:10.095213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54baca8-96ba-4a1c-933c-3edf9f7803cc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:10.184541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab079-82c8-4400-b466-40459fb759d4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:10.224140 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe9f0a-8716-447d-a212-ce9573d74c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:10.224803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe9f0a-8716-447d-a212-ce9573d74c4d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:10.225116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe9f0a-8716-447d-a212-ce9573d74c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:10.225389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe9f0a-8716-447d-a212-ce9573d74c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:10.226647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe9f0a-8716-447d-a212-ce9573d74c4d None admin] RBAC: Adding query filter params (role.id=ced9d7828d0e4de4b81ab8d0445331ea, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=e84a4f86f4c54625a22cfdcbc08da73b) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:10.226965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe9f0a-8716-447d-a212-ce9573d74c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:10.228417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe9f0a-8716-447d-a212-ce9573d74c4d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:10.245135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 478/981] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:07:10 2022] GET /identity/v3/role_assignments?user.id=e84a4f86f4c54625a22cfdcbc08da73b&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=ced9d7828d0e4de4b81ab8d0445331ea => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:10.260030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54baca8-96ba-4a1c-933c-3edf9f7803cc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:10.297077 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2473f-8290-4263-8e87-bf2ed429c32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:10.297574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2473f-8290-4263-8e87-bf2ed429c32b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:10.297869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2473f-8290-4263-8e87-bf2ed429c32b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:10.298145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2473f-8290-4263-8e87-bf2ed429c32b None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:10.298980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2473f-8290-4263-8e87-bf2ed429c32b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:10.299661 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2473f-8290-4263-8e87-bf2ed429c32b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:10.300760 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2473f-8290-4263-8e87-bf2ed429c32b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:10.344528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 504/982] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Apr 12 14:07:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:11.363953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb06cb8-d025-478c-8f28-5bcfee0b7fba None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:11.364484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb06cb8-d025-478c-8f28-5bcfee0b7fba None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:11.364736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb06cb8-d025-478c-8f28-5bcfee0b7fba None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:11.366238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 479/983] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:11.371359 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ffd01-72f1-441b-bf36-0ba3d0c60c6e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:11.371758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ffd01-72f1-441b-bf36-0ba3d0c60c6e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:11.371923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ffd01-72f1-441b-bf36-0ba3d0c60c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:11.389178 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3c8ffd01-72f1-441b-bf36-0ba3d0c60c6e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:11.392019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3c8ffd01-72f1-441b-bf36-0ba3d0c60c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:11.463297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 505/984] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:11.490256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb06cb8-d025-478c-8f28-5bcfee0b7fba None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:11.593807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb06cb8-d025-478c-8f28-5bcfee0b7fba None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:11.628626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6196d-2f55-4882-9eeb-ef1bf113ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:11.629875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6196d-2f55-4882-9eeb-ef1bf113ee5c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:11.630364 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6196d-2f55-4882-9eeb-ef1bf113ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:11.630840 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6196d-2f55-4882-9eeb-ef1bf113ee5c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:11.631689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6196d-2f55-4882-9eeb-ef1bf113ee5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:11.633311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6196d-2f55-4882-9eeb-ef1bf113ee5c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:11.644938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-1af6196d-2f55-4882-9eeb-ef1bf113ee5c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 14:07:11.646819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 480/985] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:07:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:11.652382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ffd01-72f1-441b-bf36-0ba3d0c60c6e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:11.763076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ffd01-72f1-441b-bf36-0ba3d0c60c6e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:11.797627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347129f-c9a6-4078-b3ef-edbf6cf799fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:11.798313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347129f-c9a6-4078-b3ef-edbf6cf799fd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:11.798598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347129f-c9a6-4078-b3ef-edbf6cf799fd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:11.798900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347129f-c9a6-4078-b3ef-edbf6cf799fd None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:11.799639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347129f-c9a6-4078-b3ef-edbf6cf799fd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:11.799955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347129f-c9a6-4078-b3ef-edbf6cf799fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:11.801391 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347129f-c9a6-4078-b3ef-edbf6cf799fd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:11.811921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 506/986] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:07:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:11.813332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6196d-2f55-4882-9eeb-ef1bf113ee5c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:11.915692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6196d-2f55-4882-9eeb-ef1bf113ee5c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:11.951183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6050e-ac04-4f39-8f56-92099166c3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:11.952231 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6050e-ac04-4f39-8f56-92099166c3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:11.952886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6050e-ac04-4f39-8f56-92099166c3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:11.953394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6050e-ac04-4f39-8f56-92099166c3f7 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:11.954698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6050e-ac04-4f39-8f56-92099166c3f7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:11.955216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6050e-ac04-4f39-8f56-92099166c3f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:11.956807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6050e-ac04-4f39-8f56-92099166c3f7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:11.962618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 481/987] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:07:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:11.968837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347129f-c9a6-4078-b3ef-edbf6cf799fd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:12.053916 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7ecc0-0bb1-40c3-a392-53566d2b8a00 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.054259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7ecc0-0bb1-40c3-a392-53566d2b8a00 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.054468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7ecc0-0bb1-40c3-a392-53566d2b8a00 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.055814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 482/988] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:07:12.061168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec54a3-c05c-466b-a610-ceaba2ec9cb5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.061526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec54a3-c05c-466b-a610-ceaba2ec9cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.061820 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec54a3-c05c-466b-a610-ceaba2ec9cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.079695 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-19ec54a3-c05c-466b-a610-ceaba2ec9cb5 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:12.080885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-19ec54a3-c05c-466b-a610-ceaba2ec9cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:12.085216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347129f-c9a6-4078-b3ef-edbf6cf799fd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:12.121554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2469c7-f726-4847-930a-66528d342d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:12.122633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2469c7-f726-4847-930a-66528d342d30 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.123089 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2469c7-f726-4847-930a-66528d342d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.123533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2469c7-f726-4847-930a-66528d342d30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.124955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2469c7-f726-4847-930a-66528d342d30 None admin] RBAC: Adding query filter params (interface=public, service_id=89723a5973a44e52aa3f6cf26bdcea5b, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:12.125299 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2469c7-f726-4847-930a-66528d342d30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:12.126662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2469c7-f726-4847-930a-66528d342d30 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:12.136141 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 507/989] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Apr 12 14:07:11 2022] GET /identity/v3/endpoints?service_id=89723a5973a44e52aa3f6cf26bdcea5b&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:12.137215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2469c7-f726-4847-930a-66528d342d30 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:12.162376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 483/990] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:12.187657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec54a3-c05c-466b-a610-ceaba2ec9cb5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:12.244506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2469c7-f726-4847-930a-66528d342d30 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:12.279106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6e26f-483e-45b2-9728-d9d9a706b9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:12.279927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6e26f-483e-45b2-9728-d9d9a706b9be None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.280273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6e26f-483e-45b2-9728-d9d9a706b9be None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.280798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6e26f-483e-45b2-9728-d9d9a706b9be None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.281640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6e26f-483e-45b2-9728-d9d9a706b9be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:12.283068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6e26f-483e-45b2-9728-d9d9a706b9be None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:12.297007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 508/991] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Apr 12 14:07:12 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:07:12.304574 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec54a3-c05c-466b-a610-ceaba2ec9cb5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:12.341211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e1224-0177-4419-9c16-2ff95afa916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:12.342024 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1224-0177-4419-9c16-2ff95afa916e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.342302 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1224-0177-4419-9c16-2ff95afa916e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.342601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e1224-0177-4419-9c16-2ff95afa916e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.343472 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e1224-0177-4419-9c16-2ff95afa916e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:12.344869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e1224-0177-4419-9c16-2ff95afa916e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:12.356499 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-586e1224-0177-4419-9c16-2ff95afa916e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 14:07:12.357791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 484/992] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Apr 12 14:07:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:07:12.364573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6e26f-483e-45b2-9728-d9d9a706b9be None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:12.474052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6e26f-483e-45b2-9728-d9d9a706b9be None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:12.510287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd26395-8611-448b-85c5-c831d057034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:12.510954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd26395-8611-448b-85c5-c831d057034c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.511240 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd26395-8611-448b-85c5-c831d057034c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.511514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd26395-8611-448b-85c5-c831d057034c None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.512221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd26395-8611-448b-85c5-c831d057034c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:12.512530 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd26395-8611-448b-85c5-c831d057034c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:12.513948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd26395-8611-448b-85c5-c831d057034c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:12.519943 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 509/993] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Apr 12 14:07:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:12.525478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e1224-0177-4419-9c16-2ff95afa916e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:12.622783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e1224-0177-4419-9c16-2ff95afa916e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:12.656151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbff119-1724-4b33-b592-007ebb83254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:12.656816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff119-1724-4b33-b592-007ebb83254d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.657126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff119-1724-4b33-b592-007ebb83254d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.657401 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff119-1724-4b33-b592-007ebb83254d None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.658095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbff119-1724-4b33-b592-007ebb83254d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:12.658397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbff119-1724-4b33-b592-007ebb83254d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:12.659760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbff119-1724-4b33-b592-007ebb83254d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:12.674141 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946a8c-41ba-4062-a53c-f3d8224f6f52 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.674472 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 485/994] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Apr 12 14:07:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:12.674574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946a8c-41ba-4062-a53c-f3d8224f6f52 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.674768 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946a8c-41ba-4062-a53c-f3d8224f6f52 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.675842 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbff119-1724-4b33-b592-007ebb83254d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:12.676163 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 510/995] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:12.681316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f5801-5510-4626-a774-3ee4410e4599 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.681609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f5801-5510-4626-a774-3ee4410e4599 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.681885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f5801-5510-4626-a774-3ee4410e4599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.699055 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bb8f5801-5510-4626-a774-3ee4410e4599 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:12.700245 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bb8f5801-5510-4626-a774-3ee4410e4599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:12.767839 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 511/996] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:12.778460 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbff119-1724-4b33-b592-007ebb83254d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:12.789531 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f5801-5510-4626-a774-3ee4410e4599 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:12.810875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c530ed-ae50-40bd-8929-393f7cf3f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:12.812083 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c530ed-ae50-40bd-8929-393f7cf3f318 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.812368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c530ed-ae50-40bd-8929-393f7cf3f318 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.812643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c530ed-ae50-40bd-8929-393f7cf3f318 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.813461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c530ed-ae50-40bd-8929-393f7cf3f318 None admin] RBAC: Adding query filter params (interface=admin, service_id=20b2eeef64244c948857981691d9bcc3, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:12.813773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c530ed-ae50-40bd-8929-393f7cf3f318 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:12.815146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c530ed-ae50-40bd-8929-393f7cf3f318 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:12.820602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 486/997] 10.222.0.61 () {56 vars in 1249 bytes} [Tue Apr 12 14:07:12 2022] GET /identity/v3/endpoints?service_id=20b2eeef64244c948857981691d9bcc3&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:12.825771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c530ed-ae50-40bd-8929-393f7cf3f318 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:12.893085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f5801-5510-4626-a774-3ee4410e4599 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:12.924852 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c530ed-ae50-40bd-8929-393f7cf3f318 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:12.926708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0461e1-aa0a-4f85-87b4-3b393f0d1666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:12.927499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0461e1-aa0a-4f85-87b4-3b393f0d1666 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.927786 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0461e1-aa0a-4f85-87b4-3b393f0d1666 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.928064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0461e1-aa0a-4f85-87b4-3b393f0d1666 None admin] PATH_INFO: `/v3/services/image` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.928716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0461e1-aa0a-4f85-87b4-3b393f0d1666 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:12.930120 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0461e1-aa0a-4f85-87b4-3b393f0d1666 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:12.941623 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-5d0461e1-aa0a-4f85-87b4-3b393f0d1666 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 14:07:12.942804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 512/998] 10.222.0.61 () {56 vars in 1105 bytes} [Tue Apr 12 14:07:12 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:07:12.950185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0461e1-aa0a-4f85-87b4-3b393f0d1666 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:12.961035 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd322aa-8023-4222-8f1b-a6748592bfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:12.961736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd322aa-8023-4222-8f1b-a6748592bfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:12.962020 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd322aa-8023-4222-8f1b-a6748592bfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:12.962297 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd322aa-8023-4222-8f1b-a6748592bfa3 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:12.962978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd322aa-8023-4222-8f1b-a6748592bfa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:12.964349 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd322aa-8023-4222-8f1b-a6748592bfa3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:12.971081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 487/999] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Apr 12 14:07:12 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:07:13.077062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0461e1-aa0a-4f85-87b4-3b393f0d1666 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:13.112654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce84e6-0dc5-4d0f-b90c-9bee3b9e21e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:13.113362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce84e6-0dc5-4d0f-b90c-9bee3b9e21e3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:13.113641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce84e6-0dc5-4d0f-b90c-9bee3b9e21e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:13.113914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce84e6-0dc5-4d0f-b90c-9bee3b9e21e3 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:13.114628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce84e6-0dc5-4d0f-b90c-9bee3b9e21e3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:13.114931 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce84e6-0dc5-4d0f-b90c-9bee3b9e21e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:13.116330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce84e6-0dc5-4d0f-b90c-9bee3b9e21e3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:13.121873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 513/1000] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:13.128406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd322aa-8023-4222-8f1b-a6748592bfa3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:13.229531 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd322aa-8023-4222-8f1b-a6748592bfa3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:13.262412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790b2d9-2ec2-4a16-a970-4d68fc03f0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:13.263116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b2d9-2ec2-4a16-a970-4d68fc03f0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:13.263399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b2d9-2ec2-4a16-a970-4d68fc03f0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:13.263673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b2d9-2ec2-4a16-a970-4d68fc03f0d8 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:13.264468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790b2d9-2ec2-4a16-a970-4d68fc03f0d8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:13.264955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790b2d9-2ec2-4a16-a970-4d68fc03f0d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:13.266513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790b2d9-2ec2-4a16-a970-4d68fc03f0d8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:13.270990 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 488/1001] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:14.652998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6c376-e725-4642-8512-aafdbdb78f80 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:14.653575 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6c376-e725-4642-8512-aafdbdb78f80 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:14.653575 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6c376-e725-4642-8512-aafdbdb78f80 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:14.654976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 514/1002] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:14.660402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc46a-9de3-4219-851b-8c21606e47be None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:14.660860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc46a-9de3-4219-851b-8c21606e47be None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:14.660954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc46a-9de3-4219-851b-8c21606e47be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:14.680849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3c6dc46a-9de3-4219-851b-8c21606e47be None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:14.682073 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3c6dc46a-9de3-4219-851b-8c21606e47be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:14.748942 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 489/1003] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:14.773435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6c376-e725-4642-8512-aafdbdb78f80 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:14.874736 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6c376-e725-4642-8512-aafdbdb78f80 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:14.907954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e5107-ddf2-4387-a091-e4f007fd568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:14.908694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e5107-ddf2-4387-a091-e4f007fd568b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:14.908974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e5107-ddf2-4387-a091-e4f007fd568b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:14.909267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e5107-ddf2-4387-a091-e4f007fd568b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:14.909919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e5107-ddf2-4387-a091-e4f007fd568b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:14.911306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e5107-ddf2-4387-a091-e4f007fd568b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:14.922522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-249e5107-ddf2-4387-a091-e4f007fd568b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 14:07:14.923860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 515/1004] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:07:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:14.929773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dc46a-9de3-4219-851b-8c21606e47be None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:15.030701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dc46a-9de3-4219-851b-8c21606e47be None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:15.064865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956efbf-1456-4efe-8677-137fc67cee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:15.065818 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956efbf-1456-4efe-8677-137fc67cee96 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:15.066249 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956efbf-1456-4efe-8677-137fc67cee96 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:15.066667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956efbf-1456-4efe-8677-137fc67cee96 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:15.067526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956efbf-1456-4efe-8677-137fc67cee96 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:15.067976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956efbf-1456-4efe-8677-137fc67cee96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:15.069516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956efbf-1456-4efe-8677-137fc67cee96 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:15.074744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 490/1005] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:07:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:15.081956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e5107-ddf2-4387-a091-e4f007fd568b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:15.187534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e5107-ddf2-4387-a091-e4f007fd568b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:15.226774 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253050bc-9068-4d3e-a0ee-5f7e5ce09cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:15.227500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253050bc-9068-4d3e-a0ee-5f7e5ce09cbe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:15.227812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253050bc-9068-4d3e-a0ee-5f7e5ce09cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:15.228106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253050bc-9068-4d3e-a0ee-5f7e5ce09cbe None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:15.228893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253050bc-9068-4d3e-a0ee-5f7e5ce09cbe None admin] RBAC: Adding query filter params (type=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:15.229260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253050bc-9068-4d3e-a0ee-5f7e5ce09cbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:15.230796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253050bc-9068-4d3e-a0ee-5f7e5ce09cbe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:15.237007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 516/1006] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Apr 12 14:07:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:15.247581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956efbf-1456-4efe-8677-137fc67cee96 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:15.343619 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956efbf-1456-4efe-8677-137fc67cee96 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:15.351577 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6f962-b6eb-46cb-ad29-110352e3521d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:15.351860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6f962-b6eb-46cb-ad29-110352e3521d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:15.352132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6f962-b6eb-46cb-ad29-110352e3521d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:15.353702 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 517/1007] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:07:15.359446 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e785f-cdab-4d7b-aae7-3aeb6640c032 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:15.359730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e785f-cdab-4d7b-aae7-3aeb6640c032 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:15.360006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e785f-cdab-4d7b-aae7-3aeb6640c032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:15.376956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e54e785f-cdab-4d7b-aae7-3aeb6640c032 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:15.378221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e54e785f-cdab-4d7b-aae7-3aeb6640c032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:15.378764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658aa62-3ac1-469b-ac29-40fe77bfbd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:15.379421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658aa62-3ac1-469b-ac29-40fe77bfbd75 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:15.379705 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658aa62-3ac1-469b-ac29-40fe77bfbd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:15.379987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658aa62-3ac1-469b-ac29-40fe77bfbd75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:15.380916 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658aa62-3ac1-469b-ac29-40fe77bfbd75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:15.382304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658aa62-3ac1-469b-ac29-40fe77bfbd75 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:15.449092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 518/1008] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:15.457012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 491/1009] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Apr 12 14:07:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:07:15.472662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e785f-cdab-4d7b-aae7-3aeb6640c032 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:15.580636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e785f-cdab-4d7b-aae7-3aeb6640c032 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:15.590665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c401933-abc1-4739-8623-75d89acc28b7 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:15.591007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c401933-abc1-4739-8623-75d89acc28b7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:15.591227 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c401933-abc1-4739-8623-75d89acc28b7 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:15.594742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 492/1010] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:15.599319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c280942-3c84-4742-aa43-a6d0a039ec14 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:15.599596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c280942-3c84-4742-aa43-a6d0a039ec14 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:15.599871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c280942-3c84-4742-aa43-a6d0a039ec14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:15.617538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6c280942-3c84-4742-aa43-a6d0a039ec14 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:15.618953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6c280942-3c84-4742-aa43-a6d0a039ec14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:15.627969 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a8b83-b7bd-4e92-9504-a4e026a886d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:15.628789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8b83-b7bd-4e92-9504-a4e026a886d8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:15.629098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8b83-b7bd-4e92-9504-a4e026a886d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:15.629374 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8b83-b7bd-4e92-9504-a4e026a886d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:15.630029 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a8b83-b7bd-4e92-9504-a4e026a886d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:15.631400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a8b83-b7bd-4e92-9504-a4e026a886d8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:15.643686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-177a8b83-b7bd-4e92-9504-a4e026a886d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 14:07:15.649308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 519/1011] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Apr 12 14:07:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:15.650596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a8b83-b7bd-4e92-9504-a4e026a886d8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:15.691771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 493/1012] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:15 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:15.716674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c280942-3c84-4742-aa43-a6d0a039ec14 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:15.755747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a8b83-b7bd-4e92-9504-a4e026a886d8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:15.791631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f014a40-c1de-4393-9f45-9a1cb8647323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:15.792726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014a40-c1de-4393-9f45-9a1cb8647323 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:15.793271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014a40-c1de-4393-9f45-9a1cb8647323 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:15.793546 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014a40-c1de-4393-9f45-9a1cb8647323 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:15.794248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f014a40-c1de-4393-9f45-9a1cb8647323 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:15.794553 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f014a40-c1de-4393-9f45-9a1cb8647323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:15.797330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f014a40-c1de-4393-9f45-9a1cb8647323 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:15.802518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 520/1013] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Apr 12 14:07:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:15.807980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f014a40-c1de-4393-9f45-9a1cb8647323 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:15.817779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c280942-3c84-4742-aa43-a6d0a039ec14 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:15.851412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4b405-42d2-4b84-a07c-b6eb0a658d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:15.852079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4b405-42d2-4b84-a07c-b6eb0a658d25 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:15.852360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4b405-42d2-4b84-a07c-b6eb0a658d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:15.852633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4b405-42d2-4b84-a07c-b6eb0a658d25 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:15.853380 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4b405-42d2-4b84-a07c-b6eb0a658d25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:15.854734 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4b405-42d2-4b84-a07c-b6eb0a658d25 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:15.911745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f014a40-c1de-4393-9f45-9a1cb8647323 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:15.915851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 494/1014] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:07:15 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:07:15.957328 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29edb26-6526-4984-9778-0bea53e958b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:15.958071 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29edb26-6526-4984-9778-0bea53e958b6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:15.958351 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29edb26-6526-4984-9778-0bea53e958b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:15.958622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29edb26-6526-4984-9778-0bea53e958b6 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:15.959340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29edb26-6526-4984-9778-0bea53e958b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:15.959649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29edb26-6526-4984-9778-0bea53e958b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:15.961056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29edb26-6526-4984-9778-0bea53e958b6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:15.971576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 521/1015] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Apr 12 14:07:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:15.973305 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4b405-42d2-4b84-a07c-b6eb0a658d25 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:16.080892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4b405-42d2-4b84-a07c-b6eb0a658d25 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:16.116307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14ffa3-c7c8-4a11-8052-f5c453225dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:16.116997 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14ffa3-c7c8-4a11-8052-f5c453225dba None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:16.117271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14ffa3-c7c8-4a11-8052-f5c453225dba None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:16.117548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14ffa3-c7c8-4a11-8052-f5c453225dba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:16.118294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14ffa3-c7c8-4a11-8052-f5c453225dba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:16.119651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14ffa3-c7c8-4a11-8052-f5c453225dba None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:16.190687 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 495/1016] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Apr 12 14:07:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:07:17.935461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cee51f-37a4-47c3-b432-21dd20f57a31 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:17.935982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cee51f-37a4-47c3-b432-21dd20f57a31 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:17.937237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cee51f-37a4-47c3-b432-21dd20f57a31 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:17.938794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 522/1017] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:17.943671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cfb81-04d2-4c28-a86b-e020ee4ee775 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:17.944056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cfb81-04d2-4c28-a86b-e020ee4ee775 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:17.944230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cfb81-04d2-4c28-a86b-e020ee4ee775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:17.961489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2b1cfb81-04d2-4c28-a86b-e020ee4ee775 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:17.962660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2b1cfb81-04d2-4c28-a86b-e020ee4ee775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:18.036646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 496/1018] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:18.062398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cee51f-37a4-47c3-b432-21dd20f57a31 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:18.167467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cee51f-37a4-47c3-b432-21dd20f57a31 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:18.201324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708a10e-cb19-4d0c-aa88-acb589e8cdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:18.203123 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708a10e-cb19-4d0c-aa88-acb589e8cdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.203404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708a10e-cb19-4d0c-aa88-acb589e8cdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.203675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708a10e-cb19-4d0c-aa88-acb589e8cdf0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.213930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708a10e-cb19-4d0c-aa88-acb589e8cdf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:07:18.223041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-9708a10e-cb19-4d0c-aa88-acb589e8cdf0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 14:07:18.224400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 523/1019] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Apr 12 14:07:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:18.224527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f725fac-4249-4c79-b2ce-eb934d39ddfa None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.224614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f725fac-4249-4c79-b2ce-eb934d39ddfa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.224866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f725fac-4249-4c79-b2ce-eb934d39ddfa None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.226444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 497/1020] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:07:18.229863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708a10e-cb19-4d0c-aa88-acb589e8cdf0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:18.230998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c581d2-566d-4272-9edb-4ac9803e2388 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.231284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c581d2-566d-4272-9edb-4ac9803e2388 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.231557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c581d2-566d-4272-9edb-4ac9803e2388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.249542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c7c581d2-566d-4272-9edb-4ac9803e2388 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:18.250613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c7c581d2-566d-4272-9edb-4ac9803e2388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:18.328866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 498/1021] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:18.334962 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708a10e-cb19-4d0c-aa88-acb589e8cdf0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:18.345341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c581d2-566d-4272-9edb-4ac9803e2388 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:18.370233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b6003-7b28-47e0-b681-bb01a55319e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:18.370900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6003-7b28-47e0-b681-bb01a55319e3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.371180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6003-7b28-47e0-b681-bb01a55319e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.371456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6003-7b28-47e0-b681-bb01a55319e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.372203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b6003-7b28-47e0-b681-bb01a55319e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:18.380180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b6003-7b28-47e0-b681-bb01a55319e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:18.380180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b6003-7b28-47e0-b681-bb01a55319e3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:18.387033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 524/1022] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Apr 12 14:07:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:18.387986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b6003-7b28-47e0-b681-bb01a55319e3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:18.445471 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c581d2-566d-4272-9edb-4ac9803e2388 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:18.479210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fab61-e519-4645-b7a0-1845fb5299f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:18.479867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fab61-e519-4645-b7a0-1845fb5299f4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.480149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fab61-e519-4645-b7a0-1845fb5299f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.480417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fab61-e519-4645-b7a0-1845fb5299f4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.481097 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fab61-e519-4645-b7a0-1845fb5299f4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:18.482468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fab61-e519-4645-b7a0-1845fb5299f4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:18.492126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b6003-7b28-47e0-b681-bb01a55319e3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:18.493756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-214fab61-e519-4645-b7a0-1845fb5299f4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 14:07:18.495232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 499/1023] 10.222.0.61 () {56 vars in 1105 bytes} [Tue Apr 12 14:07:18 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:18.501366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fab61-e519-4645-b7a0-1845fb5299f4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:18.531283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc957df-fa8b-4be8-9ca2-264d8f8d4502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:18.532072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc957df-fa8b-4be8-9ca2-264d8f8d4502 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.532349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc957df-fa8b-4be8-9ca2-264d8f8d4502 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.532616 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc957df-fa8b-4be8-9ca2-264d8f8d4502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.542793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc957df-fa8b-4be8-9ca2-264d8f8d4502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:18.544234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc957df-fa8b-4be8-9ca2-264d8f8d4502 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:18.559988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-6bc957df-fa8b-4be8-9ca2-264d8f8d4502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:18.561709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 525/1024] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:18.563046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c20d-50a7-454e-a11d-928c6efa0603 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.563328 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c20d-50a7-454e-a11d-928c6efa0603 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.563666 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c20d-50a7-454e-a11d-928c6efa0603 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.565030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 526/1025] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:18.567393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7c20d-50a7-454e-a11d-928c6efa0603 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:18.599996 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fab61-e519-4645-b7a0-1845fb5299f4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:18.632209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c893c-69da-4eb8-b052-124a9eb32100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:18.632898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c893c-69da-4eb8-b052-124a9eb32100 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.633211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c893c-69da-4eb8-b052-124a9eb32100 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.633488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c893c-69da-4eb8-b052-124a9eb32100 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.634289 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c893c-69da-4eb8-b052-124a9eb32100 None admin] RBAC: Adding query filter params (name=image) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:18.634598 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c893c-69da-4eb8-b052-124a9eb32100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:18.635971 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c893c-69da-4eb8-b052-124a9eb32100 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:18.646187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 500/1026] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:18.646187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e294f-03a9-45ca-8acb-592c7ef60b31 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.646187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e294f-03a9-45ca-8acb-592c7ef60b31 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.646187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e294f-03a9-45ca-8acb-592c7ef60b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.659122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-932e294f-03a9-45ca-8acb-592c7ef60b31 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:18.660317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-932e294f-03a9-45ca-8acb-592c7ef60b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:18.665483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7c20d-50a7-454e-a11d-928c6efa0603 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:18.697858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87dc1b-9efc-4bfa-bfa1-cb7ada4a0046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:18.698525 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87dc1b-9efc-4bfa-bfa1-cb7ada4a0046 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.698810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87dc1b-9efc-4bfa-bfa1-cb7ada4a0046 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.699087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87dc1b-9efc-4bfa-bfa1-cb7ada4a0046 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.699805 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87dc1b-9efc-4bfa-bfa1-cb7ada4a0046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:18.700115 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87dc1b-9efc-4bfa-bfa1-cb7ada4a0046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:18.702149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87dc1b-9efc-4bfa-bfa1-cb7ada4a0046 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:18.714410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 527/1027] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:18.715202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87dc1b-9efc-4bfa-bfa1-cb7ada4a0046 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:18.741123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 501/1028] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:18.741123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e294f-03a9-45ca-8acb-592c7ef60b31 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:18.811235 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87dc1b-9efc-4bfa-bfa1-cb7ada4a0046 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:18.820742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e294f-03a9-45ca-8acb-592c7ef60b31 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:18.844549 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de327dc-0daf-468d-a47d-1c063f496a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:18.845237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de327dc-0daf-468d-a47d-1c063f496a02 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.845528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de327dc-0daf-468d-a47d-1c063f496a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.845804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de327dc-0daf-468d-a47d-1c063f496a02 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.846537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de327dc-0daf-468d-a47d-1c063f496a02 None admin] RBAC: Adding query filter params (type=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:18.846845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de327dc-0daf-468d-a47d-1c063f496a02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:18.848202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de327dc-0daf-468d-a47d-1c063f496a02 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:18.852816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 528/1029] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:18.853623 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de327dc-0daf-468d-a47d-1c063f496a02 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:18.853730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81ab2-7cda-4215-9ff7-b8d51923868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:18.854404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81ab2-7cda-4215-9ff7-b8d51923868c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.854683 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81ab2-7cda-4215-9ff7-b8d51923868c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.854960 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81ab2-7cda-4215-9ff7-b8d51923868c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.862647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c81ab2-7cda-4215-9ff7-b8d51923868c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:18.864094 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c81ab2-7cda-4215-9ff7-b8d51923868c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:18.877975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-07c81ab2-7cda-4215-9ff7-b8d51923868c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 14:07:18.879157 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 502/1030] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Apr 12 14:07:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:18.879909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81ab2-7cda-4215-9ff7-b8d51923868c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:18.951561 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de327dc-0daf-468d-a47d-1c063f496a02 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:18.977502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81ab2-7cda-4215-9ff7-b8d51923868c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:18.983909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627e64d-36fd-4715-af95-c752b5f16755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:18.984696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e64d-36fd-4715-af95-c752b5f16755 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:18.985003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e64d-36fd-4715-af95-c752b5f16755 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:18.985282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e64d-36fd-4715-af95-c752b5f16755 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:18.986454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627e64d-36fd-4715-af95-c752b5f16755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:18.987870 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627e64d-36fd-4715-af95-c752b5f16755 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:18.989523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 529/1031] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:18.990281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627e64d-36fd-4715-af95-c752b5f16755 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:19.011716 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9beebc3-4cfe-455c-9bf9-929afedf4778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:19.012298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9beebc3-4cfe-455c-9bf9-929afedf4778 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:19.012580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9beebc3-4cfe-455c-9bf9-929afedf4778 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:19.012853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9beebc3-4cfe-455c-9bf9-929afedf4778 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:19.013662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9beebc3-4cfe-455c-9bf9-929afedf4778 None admin] RBAC: Adding query filter params (interface=public, service_id=d76ac31161584754ab44544e941dc7ac, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:19.014021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9beebc3-4cfe-455c-9bf9-929afedf4778 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:19.015392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9beebc3-4cfe-455c-9bf9-929afedf4778 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:19.020164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 503/1032] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Apr 12 14:07:18 2022] GET /identity/v3/endpoints?service_id=d76ac31161584754ab44544e941dc7ac&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:19.020901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9beebc3-4cfe-455c-9bf9-929afedf4778 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:19.085929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627e64d-36fd-4715-af95-c752b5f16755 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:19.117290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9beebc3-4cfe-455c-9bf9-929afedf4778 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:19.119476 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4286f-712f-4ab3-ba89-487e5e23a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:19.120143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4286f-712f-4ab3-ba89-487e5e23a242 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:19.120427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4286f-712f-4ab3-ba89-487e5e23a242 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:19.120703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4286f-712f-4ab3-ba89-487e5e23a242 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:19.121568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4286f-712f-4ab3-ba89-487e5e23a242 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:19.121884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4286f-712f-4ab3-ba89-487e5e23a242 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:19.123385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4286f-712f-4ab3-ba89-487e5e23a242 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:19.141487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 530/1033] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Apr 12 14:07:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:19.142376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4286f-712f-4ab3-ba89-487e5e23a242 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:19.150978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80ac2-5a18-448f-95b6-0be736721602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:19.151629 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80ac2-5a18-448f-95b6-0be736721602 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:19.151910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80ac2-5a18-448f-95b6-0be736721602 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:19.152174 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80ac2-5a18-448f-95b6-0be736721602 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:19.152874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e80ac2-5a18-448f-95b6-0be736721602 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:19.154307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e80ac2-5a18-448f-95b6-0be736721602 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:19.236385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4286f-712f-4ab3-ba89-487e5e23a242 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:19.263970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 504/1034] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:07:19 2022] POST /identity/v3/projects => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:07:19.264929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80ac2-5a18-448f-95b6-0be736721602 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:19.271255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af821861-0979-40dd-8052-5388644fcff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:19.271996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af821861-0979-40dd-8052-5388644fcff7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:19.272346 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af821861-0979-40dd-8052-5388644fcff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:19.272612 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af821861-0979-40dd-8052-5388644fcff7 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:19.273334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af821861-0979-40dd-8052-5388644fcff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:19.274828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af821861-0979-40dd-8052-5388644fcff7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:19.283323 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 531/1035] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Apr 12 14:07:19 2022] GET /identity/v3/services => generated 1957 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:07:19.381639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80ac2-5a18-448f-95b6-0be736721602 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:19.419884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec1462-a4c5-4ea1-886f-f4a1587bb3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:19.421337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec1462-a4c5-4ea1-886f-f4a1587bb3ba None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:19.421623 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec1462-a4c5-4ea1-886f-f4a1587bb3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:19.421899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec1462-a4c5-4ea1-886f-f4a1587bb3ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:19.496570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec1462-a4c5-4ea1-886f-f4a1587bb3ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:19.498086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec1462-a4c5-4ea1-886f-f4a1587bb3ba None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:19.598576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 505/1036] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:07:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:07:19.604628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af821861-0979-40dd-8052-5388644fcff7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:19.715873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af821861-0979-40dd-8052-5388644fcff7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:19.749053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec96484-eb58-4690-a8b7-6a0f41ed7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:19.749824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96484-eb58-4690-a8b7-6a0f41ed7db3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:19.750112 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96484-eb58-4690-a8b7-6a0f41ed7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:19.750402 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96484-eb58-4690-a8b7-6a0f41ed7db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:19.760433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec96484-eb58-4690-a8b7-6a0f41ed7db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:19.761930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec96484-eb58-4690-a8b7-6a0f41ed7db3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:19.779232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-7ec96484-eb58-4690-a8b7-6a0f41ed7db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:19.780734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 532/1037] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:19.786207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec1462-a4c5-4ea1-886f-f4a1587bb3ba None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:19.880236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec1462-a4c5-4ea1-886f-f4a1587bb3ba None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:19.911678 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e34616-3054-4b80-b5e4-5f4a5d893ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:19.912334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e34616-3054-4b80-b5e4-5f4a5d893ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:19.912616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e34616-3054-4b80-b5e4-5f4a5d893ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:19.912888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e34616-3054-4b80-b5e4-5f4a5d893ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:19.913633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e34616-3054-4b80-b5e4-5f4a5d893ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:19.913941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e34616-3054-4b80-b5e4-5f4a5d893ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:19.915300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e34616-3054-4b80-b5e4-5f4a5d893ad6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:19.931116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 506/1038] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:19.933145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec96484-eb58-4690-a8b7-6a0f41ed7db3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:20.031292 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec96484-eb58-4690-a8b7-6a0f41ed7db3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:20.066354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def58f7-0ff2-4bae-b08c-4e2896c6b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:20.067524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def58f7-0ff2-4bae-b08c-4e2896c6b1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:20.068041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def58f7-0ff2-4bae-b08c-4e2896c6b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:20.068512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def58f7-0ff2-4bae-b08c-4e2896c6b1f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:20.075568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def58f7-0ff2-4bae-b08c-4e2896c6b1f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:20.077949 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def58f7-0ff2-4bae-b08c-4e2896c6b1f2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:20.091603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-4def58f7-0ff2-4bae-b08c-4e2896c6b1f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:07:20.097982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 533/1039] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:20.099173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e34616-3054-4b80-b5e4-5f4a5d893ad6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:20.200370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e34616-3054-4b80-b5e4-5f4a5d893ad6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:20.234320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d8be4-12bc-4d68-980e-dde6c34282f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:20.234974 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d8be4-12bc-4d68-980e-dde6c34282f8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:20.238377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d8be4-12bc-4d68-980e-dde6c34282f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:20.238377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d8be4-12bc-4d68-980e-dde6c34282f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:20.238377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d8be4-12bc-4d68-980e-dde6c34282f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:20.238377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d8be4-12bc-4d68-980e-dde6c34282f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:20.238377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d8be4-12bc-4d68-980e-dde6c34282f8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:20.256226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 507/1040] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:07:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:20.257824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def58f7-0ff2-4bae-b08c-4e2896c6b1f2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:20.355790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def58f7-0ff2-4bae-b08c-4e2896c6b1f2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:20.389941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0637c-07fd-49cb-9e93-45a3cd62e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:20.390362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0637c-07fd-49cb-9e93-45a3cd62e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:20.390640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0637c-07fd-49cb-9e93-45a3cd62e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:20.390910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0637c-07fd-49cb-9e93-45a3cd62e8a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:20.391729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0637c-07fd-49cb-9e93-45a3cd62e8a3 None admin] RBAC: Adding query filter params (role.id=ced9d7828d0e4de4b81ab8d0445331ea, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=b9933c6dc8f74cd59f6a1f8c11abf652) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:20.392037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0637c-07fd-49cb-9e93-45a3cd62e8a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:20.393467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0637c-07fd-49cb-9e93-45a3cd62e8a3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:20.399279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 534/1041] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:07:20 2022] GET /identity/v3/role_assignments?user.id=b9933c6dc8f74cd59f6a1f8c11abf652&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=ced9d7828d0e4de4b81ab8d0445331ea => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:21.669689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d6501-93eb-42a2-a003-1a83c072400d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:21.670669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d6501-93eb-42a2-a003-1a83c072400d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:21.670864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d6501-93eb-42a2-a003-1a83c072400d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:21.672767 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 508/1042] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:21.677324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e00d0-7a76-4d74-b869-9dd1129b6f7f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:21.677742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8daa84-8c2a-4277-8369-a623382da35d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:21.677820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e00d0-7a76-4d74-b869-9dd1129b6f7f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:21.677890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8daa84-8c2a-4277-8369-a623382da35d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:21.677980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e00d0-7a76-4d74-b869-9dd1129b6f7f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:21.678052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8daa84-8c2a-4277-8369-a623382da35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:21.679337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 535/1043] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:21.684024 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779fe70-682d-4439-a304-142193cdc4e0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:21.684310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779fe70-682d-4439-a304-142193cdc4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:21.684590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779fe70-682d-4439-a304-142193cdc4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:21.695534 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6e8daa84-8c2a-4277-8369-a623382da35d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:21.696950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6e8daa84-8c2a-4277-8369-a623382da35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:21.702265 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f779fe70-682d-4439-a304-142193cdc4e0 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:21.703623 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f779fe70-682d-4439-a304-142193cdc4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:21.764557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 509/1044] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:21.767698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 536/1045] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:21.791030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8daa84-8c2a-4277-8369-a623382da35d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:21.791762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779fe70-682d-4439-a304-142193cdc4e0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:21.888502 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779fe70-682d-4439-a304-142193cdc4e0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:21.892366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8daa84-8c2a-4277-8369-a623382da35d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:21.924004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee91550-3f4f-4c53-b997-f405332554bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:21.924687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91550-3f4f-4c53-b997-f405332554bc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:21.924993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91550-3f4f-4c53-b997-f405332554bc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:21.925262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee91550-3f4f-4c53-b997-f405332554bc None admin] PATH_INFO: `/v3/services/image` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:21.925540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98897d46-36bf-48f0-a0c8-524d0b78a69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:21.925911 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee91550-3f4f-4c53-b997-f405332554bc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:21.926327 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98897d46-36bf-48f0-a0c8-524d0b78a69e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:21.926606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98897d46-36bf-48f0-a0c8-524d0b78a69e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:21.926878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98897d46-36bf-48f0-a0c8-524d0b78a69e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:21.927271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee91550-3f4f-4c53-b997-f405332554bc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:21.928094 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98897d46-36bf-48f0-a0c8-524d0b78a69e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:21.929558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98897d46-36bf-48f0-a0c8-524d0b78a69e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:21.931319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 510/1046] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:21.936678 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98897d46-36bf-48f0-a0c8-524d0b78a69e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:21.940314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-dee91550-3f4f-4c53-b997-f405332554bc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 14:07:21.941669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 537/1047] 10.222.0.61 () {56 vars in 1105 bytes} [Tue Apr 12 14:07:21 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:07:21.947470 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee91550-3f4f-4c53-b997-f405332554bc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:22.039513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98897d46-36bf-48f0-a0c8-524d0b78a69e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:22.046652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee91550-3f4f-4c53-b997-f405332554bc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:22.074452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6ff6e-4cf9-4fc5-bfcb-7f99d520ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:22.075130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6ff6e-4cf9-4fc5-bfcb-7f99d520ea4f None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:22.075417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6ff6e-4cf9-4fc5-bfcb-7f99d520ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:22.075685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6ff6e-4cf9-4fc5-bfcb-7f99d520ea4f None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:22.076923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6ff6e-4cf9-4fc5-bfcb-7f99d520ea4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:22.078424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6ff6e-4cf9-4fc5-bfcb-7f99d520ea4f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:22.081344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f124999-22b6-4ac2-a7a6-2435bc283d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:22.082003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f124999-22b6-4ac2-a7a6-2435bc283d10 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:22.082282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f124999-22b6-4ac2-a7a6-2435bc283d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:22.082554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f124999-22b6-4ac2-a7a6-2435bc283d10 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:22.083251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f124999-22b6-4ac2-a7a6-2435bc283d10 None admin] RBAC: Adding query filter params (name=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:22.083554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f124999-22b6-4ac2-a7a6-2435bc283d10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:22.084900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f124999-22b6-4ac2-a7a6-2435bc283d10 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:22.090805 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 538/1048] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:22.096536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f124999-22b6-4ac2-a7a6-2435bc283d10 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:22.177008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 511/1049] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:07:21 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:07:22.203997 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f124999-22b6-4ac2-a7a6-2435bc283d10 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:22.243622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf19789-ce89-4859-bec8-51753f0669fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:22.244353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19789-ce89-4859-bec8-51753f0669fc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:22.244665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19789-ce89-4859-bec8-51753f0669fc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:22.244994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19789-ce89-4859-bec8-51753f0669fc None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:22.245808 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19789-ce89-4859-bec8-51753f0669fc None admin] RBAC: Adding query filter params (type=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:22.246165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19789-ce89-4859-bec8-51753f0669fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:22.247753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19789-ce89-4859-bec8-51753f0669fc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:22.258610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 539/1050] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:22.259873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6ff6e-4cf9-4fc5-bfcb-7f99d520ea4f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:22.368628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6ff6e-4cf9-4fc5-bfcb-7f99d520ea4f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:22.405462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11b87d-b244-47e6-a4ce-82e3294279ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:22.406127 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b87d-b244-47e6-a4ce-82e3294279ef None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:22.406408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b87d-b244-47e6-a4ce-82e3294279ef None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:22.406681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b87d-b244-47e6-a4ce-82e3294279ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:22.407417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11b87d-b244-47e6-a4ce-82e3294279ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:22.408788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11b87d-b244-47e6-a4ce-82e3294279ef None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:22.476378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 512/1051] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Apr 12 14:07:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:07:22.738893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15beba-dc73-4951-872c-16bb9c9c16da None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:22.739385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15beba-dc73-4951-872c-16bb9c9c16da None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:22.739385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15beba-dc73-4951-872c-16bb9c9c16da None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:22.740861 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 540/1052] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:22.746074 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf513610-6cca-4c0e-aa84-47200c6ccfe6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:22.746475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf513610-6cca-4c0e-aa84-47200c6ccfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:22.746656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf513610-6cca-4c0e-aa84-47200c6ccfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:22.763417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bf513610-6cca-4c0e-aa84-47200c6ccfe6 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:22.764620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bf513610-6cca-4c0e-aa84-47200c6ccfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:22.834141 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 513/1053] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:22.856799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15beba-dc73-4951-872c-16bb9c9c16da None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:22.963291 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15beba-dc73-4951-872c-16bb9c9c16da None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:22.996812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a9155-007e-422b-b4cc-67bd2c7e9e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:22.997569 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a9155-007e-422b-b4cc-67bd2c7e9e2f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:22.997857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a9155-007e-422b-b4cc-67bd2c7e9e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:22.998777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a9155-007e-422b-b4cc-67bd2c7e9e2f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:23.009603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a9155-007e-422b-b4cc-67bd2c7e9e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:07:23.018008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-de9a9155-007e-422b-b4cc-67bd2c7e9e2f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 14:07:23.019413 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 541/1054] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Apr 12 14:07:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:23.026753 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf513610-6cca-4c0e-aa84-47200c6ccfe6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:23.123639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf513610-6cca-4c0e-aa84-47200c6ccfe6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:23.156912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9da12-a2c0-487b-a218-3af32f32630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:23.157759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9da12-a2c0-487b-a218-3af32f32630d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:23.158047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9da12-a2c0-487b-a218-3af32f32630d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:23.158322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9da12-a2c0-487b-a218-3af32f32630d None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:23.159066 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9da12-a2c0-487b-a218-3af32f32630d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:23.159371 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9da12-a2c0-487b-a218-3af32f32630d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:23.161525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9da12-a2c0-487b-a218-3af32f32630d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:23.169699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 514/1055] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Apr 12 14:07:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:23.175893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a9155-007e-422b-b4cc-67bd2c7e9e2f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:23.277796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a9155-007e-422b-b4cc-67bd2c7e9e2f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:23.313320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05709d2d-3813-412f-b861-62fde50f6169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:23.314130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05709d2d-3813-412f-b861-62fde50f6169 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:23.314410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05709d2d-3813-412f-b861-62fde50f6169 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:23.314680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05709d2d-3813-412f-b861-62fde50f6169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:23.325207 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05709d2d-3813-412f-b861-62fde50f6169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:23.327452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05709d2d-3813-412f-b861-62fde50f6169 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:23.344602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-05709d2d-3813-412f-b861-62fde50f6169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:23.346106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 542/1056] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:23.351749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9da12-a2c0-487b-a218-3af32f32630d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:23.456247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9da12-a2c0-487b-a218-3af32f32630d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:23.490303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff5583-ea01-4da0-be5a-b3d9221dab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:23.491320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff5583-ea01-4da0-be5a-b3d9221dab64 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:23.491827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff5583-ea01-4da0-be5a-b3d9221dab64 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:23.492301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff5583-ea01-4da0-be5a-b3d9221dab64 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:23.493266 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff5583-ea01-4da0-be5a-b3d9221dab64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:23.493772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff5583-ea01-4da0-be5a-b3d9221dab64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:23.495493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff5583-ea01-4da0-be5a-b3d9221dab64 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:23.508531 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 515/1057] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:23.513710 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05709d2d-3813-412f-b861-62fde50f6169 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:23.611784 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05709d2d-3813-412f-b861-62fde50f6169 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:23.648088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d275b7-a522-48b3-9d89-79711bb25aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:23.648884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d275b7-a522-48b3-9d89-79711bb25aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:23.649190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d275b7-a522-48b3-9d89-79711bb25aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:23.649466 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d275b7-a522-48b3-9d89-79711bb25aa6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:23.657522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d275b7-a522-48b3-9d89-79711bb25aa6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:23.658965 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d275b7-a522-48b3-9d89-79711bb25aa6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:23.677194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-f6d275b7-a522-48b3-9d89-79711bb25aa6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 14:07:23.682971 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 543/1058] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Apr 12 14:07:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:23.684124 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff5583-ea01-4da0-be5a-b3d9221dab64 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:23.787550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff5583-ea01-4da0-be5a-b3d9221dab64 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:23.821604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85530a-2a64-47d8-a1aa-746ac1333902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:23.822278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85530a-2a64-47d8-a1aa-746ac1333902 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:23.822567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85530a-2a64-47d8-a1aa-746ac1333902 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:23.822844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85530a-2a64-47d8-a1aa-746ac1333902 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:23.823681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85530a-2a64-47d8-a1aa-746ac1333902 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:23.823994 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85530a-2a64-47d8-a1aa-746ac1333902 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:23.825446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85530a-2a64-47d8-a1aa-746ac1333902 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:23.847545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 516/1059] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Apr 12 14:07:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:23.850504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d275b7-a522-48b3-9d89-79711bb25aa6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:23.956435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d275b7-a522-48b3-9d89-79711bb25aa6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:23.991257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65d18c-b792-4c19-a732-5bd3d96ea888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:23.992077 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65d18c-b792-4c19-a732-5bd3d96ea888 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:23.992357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65d18c-b792-4c19-a732-5bd3d96ea888 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:23.992628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65d18c-b792-4c19-a732-5bd3d96ea888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:24.004128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65d18c-b792-4c19-a732-5bd3d96ea888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:24.005632 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65d18c-b792-4c19-a732-5bd3d96ea888 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:24.024691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-fa65d18c-b792-4c19-a732-5bd3d96ea888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:24.026169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 544/1060] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:24.032362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85530a-2a64-47d8-a1aa-746ac1333902 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:24.132012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85530a-2a64-47d8-a1aa-746ac1333902 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:24.171988 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f4ffa-df10-4b4c-8738-1326022021a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:24.172772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f4ffa-df10-4b4c-8738-1326022021a8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:24.173108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f4ffa-df10-4b4c-8738-1326022021a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:24.173391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f4ffa-df10-4b4c-8738-1326022021a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:24.174264 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f4ffa-df10-4b4c-8738-1326022021a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:24.174643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f4ffa-df10-4b4c-8738-1326022021a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:24.176660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f4ffa-df10-4b4c-8738-1326022021a8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:24.190786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 517/1061] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:24.197312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65d18c-b792-4c19-a732-5bd3d96ea888 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:24.301268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65d18c-b792-4c19-a732-5bd3d96ea888 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:24.338789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3f511-cf47-43e3-a5ed-62946dfaa97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:24.339599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3f511-cf47-43e3-a5ed-62946dfaa97b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:24.339882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3f511-cf47-43e3-a5ed-62946dfaa97b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:24.340156 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3f511-cf47-43e3-a5ed-62946dfaa97b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:24.347406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3f511-cf47-43e3-a5ed-62946dfaa97b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:24.348899 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3f511-cf47-43e3-a5ed-62946dfaa97b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:24.362295 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-22b3f511-cf47-43e3-a5ed-62946dfaa97b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:07:24.363683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 545/1062] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:07:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:24.369311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f4ffa-df10-4b4c-8738-1326022021a8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:24.472053 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f4ffa-df10-4b4c-8738-1326022021a8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:24.506657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d8f52-fcae-46de-9b4b-fe714f079111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:24.507317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d8f52-fcae-46de-9b4b-fe714f079111 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:24.507601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d8f52-fcae-46de-9b4b-fe714f079111 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:24.507876 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d8f52-fcae-46de-9b4b-fe714f079111 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:24.508654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d8f52-fcae-46de-9b4b-fe714f079111 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:24.508979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d8f52-fcae-46de-9b4b-fe714f079111 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:24.510427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d8f52-fcae-46de-9b4b-fe714f079111 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:24.527752 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 518/1063] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:07:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:24.529400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3f511-cf47-43e3-a5ed-62946dfaa97b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:24.593816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41809d-9de9-4695-aae5-8c07802b2757 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:24.594008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41809d-9de9-4695-aae5-8c07802b2757 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:24.594283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41809d-9de9-4695-aae5-8c07802b2757 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:24.595779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 519/1064] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:24.600485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379ccb5-c53e-4116-a4bb-ec731a63e8a3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:24.600745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379ccb5-c53e-4116-a4bb-ec731a63e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:24.601068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379ccb5-c53e-4116-a4bb-ec731a63e8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:24.618457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6379ccb5-c53e-4116-a4bb-ec731a63e8a3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:24.619632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6379ccb5-c53e-4116-a4bb-ec731a63e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:24.637501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3f511-cf47-43e3-a5ed-62946dfaa97b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:24.682269 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c604ffe-1657-471b-a13a-f4794241c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:24.683333 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c604ffe-1657-471b-a13a-f4794241c8d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:24.683618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c604ffe-1657-471b-a13a-f4794241c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:24.683890 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c604ffe-1657-471b-a13a-f4794241c8d5 None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/b9933c6dc8f74cd59f6a1f8c11abf652/roles/ced9d7828d0e4de4b81ab8d0445331ea` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:24.686345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c604ffe-1657-471b-a13a-f4794241c8d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=b9933c6dc8f74cd59f6a1f8c11abf652, role_id=ced9d7828d0e4de4b81ab8d0445331ea)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:24.687768 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c604ffe-1657-471b-a13a-f4794241c8d5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:24.692040 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 520/1065] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:24.718370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379ccb5-c53e-4116-a4bb-ec731a63e8a3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:24.781244 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 546/1066] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:07:24 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/b9933c6dc8f74cd59f6a1f8c11abf652/roles/ced9d7828d0e4de4b81ab8d0445331ea => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:07:24.827365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379ccb5-c53e-4116-a4bb-ec731a63e8a3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:24.842251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a50d-5d04-45a0-8fc9-4cff505c75d8 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:24.842532 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a50d-5d04-45a0-8fc9-4cff505c75d8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:24.842814 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a50d-5d04-45a0-8fc9-4cff505c75d8 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:24.844312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 547/1067] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:07:24.849834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2ea66-09ee-45d1-bc59-d00ff29d29dd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:24.850126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2ea66-09ee-45d1-bc59-d00ff29d29dd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:24.850402 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2ea66-09ee-45d1-bc59-d00ff29d29dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:24.866968 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13805e-48b4-4fe1-afb7-ebd97095d5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:24.868197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13805e-48b4-4fe1-afb7-ebd97095d5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:24.868315 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1bd2ea66-09ee-45d1-bc59-d00ff29d29dd None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:24.869178 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13805e-48b4-4fe1-afb7-ebd97095d5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:24.869474 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1bd2ea66-09ee-45d1-bc59-d00ff29d29dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:24.869869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13805e-48b4-4fe1-afb7-ebd97095d5b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:24.883372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13805e-48b4-4fe1-afb7-ebd97095d5b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:07:24.891399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-dc13805e-48b4-4fe1-afb7-ebd97095d5b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:07:24.892934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 521/1068] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:07:24.898839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13805e-48b4-4fe1-afb7-ebd97095d5b1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:24.949009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 548/1069] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:24.963532 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2ea66-09ee-45d1-bc59-d00ff29d29dd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:25.006167 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13805e-48b4-4fe1-afb7-ebd97095d5b1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:25.041110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051d309-f56c-48bc-8f45-0bfb2805b39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:25.041780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051d309-f56c-48bc-8f45-0bfb2805b39e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:25.042062 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051d309-f56c-48bc-8f45-0bfb2805b39e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:25.042340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051d309-f56c-48bc-8f45-0bfb2805b39e None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:25.043090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051d309-f56c-48bc-8f45-0bfb2805b39e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:25.043394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051d309-f56c-48bc-8f45-0bfb2805b39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:25.045329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051d309-f56c-48bc-8f45-0bfb2805b39e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:25.053886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 522/1070] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:25.059311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051d309-f56c-48bc-8f45-0bfb2805b39e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:25.073878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2ea66-09ee-45d1-bc59-d00ff29d29dd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:25.109354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f73ebc-fbe9-41f9-969e-3e0355fb63b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:25.110371 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73ebc-fbe9-41f9-969e-3e0355fb63b4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:25.110897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73ebc-fbe9-41f9-969e-3e0355fb63b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:25.111386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73ebc-fbe9-41f9-969e-3e0355fb63b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:25.159193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051d309-f56c-48bc-8f45-0bfb2805b39e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:25.182318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f73ebc-fbe9-41f9-969e-3e0355fb63b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:25.183849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f73ebc-fbe9-41f9-969e-3e0355fb63b4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:25.193675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881b35a-a589-4b99-9cc8-4ba0f4c97de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:25.194820 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b35a-a589-4b99-9cc8-4ba0f4c97de9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:25.195100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b35a-a589-4b99-9cc8-4ba0f4c97de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:25.195369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b35a-a589-4b99-9cc8-4ba0f4c97de9 None admin] PATH_INFO: `/v3/users/37cff6e0d258481089ee9f6b7f109c62` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:25.208412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881b35a-a589-4b99-9cc8-4ba0f4c97de9 None admin] RBAC: Authorizing `identity:get_user(user_id=37cff6e0d258481089ee9f6b7f109c62)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:25.209897 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881b35a-a589-4b99-9cc8-4ba0f4c97de9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:25.216328 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 523/1071] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:07:25 2022] GET /identity/v3/users/37cff6e0d258481089ee9f6b7f109c62 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:25.217676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881b35a-a589-4b99-9cc8-4ba0f4c97de9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:25.283686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 549/1072] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:07:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:07:25.290504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f73ebc-fbe9-41f9-969e-3e0355fb63b4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:25.319571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881b35a-a589-4b99-9cc8-4ba0f4c97de9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:25.355402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6736f72-d588-418c-8a6e-f0e04072025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:25.356038 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6736f72-d588-418c-8a6e-f0e04072025e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:25.356316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6736f72-d588-418c-8a6e-f0e04072025e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:25.356586 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6736f72-d588-418c-8a6e-f0e04072025e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:25.390940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f73ebc-fbe9-41f9-969e-3e0355fb63b4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:25.424282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6736f72-d588-418c-8a6e-f0e04072025e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:25.425763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6736f72-d588-418c-8a6e-f0e04072025e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:25.427428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c6421-b049-4541-953c-1cae5065a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:25.428277 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c6421-b049-4541-953c-1cae5065a9ae None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:25.428561 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c6421-b049-4541-953c-1cae5065a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:25.428837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c6421-b049-4541-953c-1cae5065a9ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:25.439063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c6421-b049-4541-953c-1cae5065a9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:25.440536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c6421-b049-4541-953c-1cae5065a9ae None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:25.457645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-738c6421-b049-4541-953c-1cae5065a9ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:25.463524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 550/1073] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:25.464548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c6421-b049-4541-953c-1cae5065a9ae None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:25.526438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 524/1074] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:07:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:07:25.532775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6736f72-d588-418c-8a6e-f0e04072025e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:25.564603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c6421-b049-4541-953c-1cae5065a9ae None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:25.601548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415219f8-231c-40cd-a918-5d515a2d1fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:25.602213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415219f8-231c-40cd-a918-5d515a2d1fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:25.602555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415219f8-231c-40cd-a918-5d515a2d1fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:25.602835 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415219f8-231c-40cd-a918-5d515a2d1fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:25.603626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415219f8-231c-40cd-a918-5d515a2d1fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:25.603944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415219f8-231c-40cd-a918-5d515a2d1fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:25.605330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415219f8-231c-40cd-a918-5d515a2d1fe9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:25.629022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 551/1075] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:25.632335 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6736f72-d588-418c-8a6e-f0e04072025e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:25.674259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155ff74-fb81-437d-bcd9-28980e1694bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:25.675137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ff74-fb81-437d-bcd9-28980e1694bb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:25.675420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ff74-fb81-437d-bcd9-28980e1694bb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:25.675694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ff74-fb81-437d-bcd9-28980e1694bb None admin] PATH_INFO: `/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:25.677106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155ff74-fb81-437d-bcd9-28980e1694bb None admin] RBAC: Authorizing `identity:get_project(project_id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:25.678618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155ff74-fb81-437d-bcd9-28980e1694bb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:25.686044 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 525/1076] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:07:25 2022] GET /identity/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:25.687539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415219f8-231c-40cd-a918-5d515a2d1fe9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:25.793826 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415219f8-231c-40cd-a918-5d515a2d1fe9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:25.836824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14244ec0-54e1-4697-8599-ef5fa8e337b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:25.837517 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14244ec0-54e1-4697-8599-ef5fa8e337b9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:25.837799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14244ec0-54e1-4697-8599-ef5fa8e337b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:25.838073 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14244ec0-54e1-4697-8599-ef5fa8e337b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:25.838906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14244ec0-54e1-4697-8599-ef5fa8e337b9 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1, user.id=37cff6e0d258481089ee9f6b7f109c62) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:25.839222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14244ec0-54e1-4697-8599-ef5fa8e337b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:25.840639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14244ec0-54e1-4697-8599-ef5fa8e337b9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:25.846706 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 552/1077] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:07:25 2022] GET /identity/v3/role_assignments?user.id=37cff6e0d258481089ee9f6b7f109c62&scope.project.id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:27.094701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18c38e-39d5-4b57-b13a-ab669f24a905 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:27.095216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18c38e-39d5-4b57-b13a-ab669f24a905 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:27.095216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18c38e-39d5-4b57-b13a-ab669f24a905 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:27.096566 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 526/1078] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:27.101878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef97f1-1d79-468b-8518-12ada2ab0f61 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:27.102279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef97f1-1d79-468b-8518-12ada2ab0f61 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:27.102535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef97f1-1d79-468b-8518-12ada2ab0f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:27.122092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-50ef97f1-1d79-468b-8518-12ada2ab0f61 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:27.124409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-50ef97f1-1d79-468b-8518-12ada2ab0f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:27.188098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 553/1079] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:27.213310 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18c38e-39d5-4b57-b13a-ab669f24a905 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:27.309052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18c38e-39d5-4b57-b13a-ab669f24a905 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:27.341600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b6249-f075-4988-85e9-e859e5c04b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:27.342386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6249-f075-4988-85e9-e859e5c04b2d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:27.342661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6249-f075-4988-85e9-e859e5c04b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:27.342927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6249-f075-4988-85e9-e859e5c04b2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:27.352498 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b6249-f075-4988-85e9-e859e5c04b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:07:27.360465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-d76b6249-f075-4988-85e9-e859e5c04b2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 14:07:27.361678 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 527/1080] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Apr 12 14:07:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:27.367489 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef97f1-1d79-468b-8518-12ada2ab0f61 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:27.464285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef97f1-1d79-468b-8518-12ada2ab0f61 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:27.496937 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e65cf3-1961-4f33-8b86-44037e9ceac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:27.498167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e65cf3-1961-4f33-8b86-44037e9ceac4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:27.498457 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e65cf3-1961-4f33-8b86-44037e9ceac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:27.498731 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e65cf3-1961-4f33-8b86-44037e9ceac4 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:27.499469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e65cf3-1961-4f33-8b86-44037e9ceac4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:27.499776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e65cf3-1961-4f33-8b86-44037e9ceac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:27.501158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e65cf3-1961-4f33-8b86-44037e9ceac4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:27.508769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 554/1081] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Apr 12 14:07:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:27.514842 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b6249-f075-4988-85e9-e859e5c04b2d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:27.614096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b6249-f075-4988-85e9-e859e5c04b2d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:27.645560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815e6a-1734-4b99-bdaf-456fc03bd911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:27.646339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815e6a-1734-4b99-bdaf-456fc03bd911 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:27.646617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815e6a-1734-4b99-bdaf-456fc03bd911 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:27.646886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815e6a-1734-4b99-bdaf-456fc03bd911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:27.657410 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8815e6a-1734-4b99-bdaf-456fc03bd911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:27.658838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8815e6a-1734-4b99-bdaf-456fc03bd911 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:27.675683 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-c8815e6a-1734-4b99-bdaf-456fc03bd911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:27.676905 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 528/1082] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:27.682512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e65cf3-1961-4f33-8b86-44037e9ceac4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:27.783546 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e65cf3-1961-4f33-8b86-44037e9ceac4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:27.818022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8e0c6-cf14-41df-ab34-6c0eccf659bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:27.818692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8e0c6-cf14-41df-ab34-6c0eccf659bc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:27.818977 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8e0c6-cf14-41df-ab34-6c0eccf659bc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:27.819514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8e0c6-cf14-41df-ab34-6c0eccf659bc None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:27.820259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8e0c6-cf14-41df-ab34-6c0eccf659bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:27.820566 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8e0c6-cf14-41df-ab34-6c0eccf659bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:27.821977 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8e0c6-cf14-41df-ab34-6c0eccf659bc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:27.834194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 555/1083] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:27.839781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815e6a-1734-4b99-bdaf-456fc03bd911 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:27.939790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815e6a-1734-4b99-bdaf-456fc03bd911 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:27.973025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de27e9-6581-4249-9dcb-967fceb08689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:27.973811 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de27e9-6581-4249-9dcb-967fceb08689 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:27.974093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de27e9-6581-4249-9dcb-967fceb08689 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:27.974365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de27e9-6581-4249-9dcb-967fceb08689 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:27.981779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de27e9-6581-4249-9dcb-967fceb08689 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:27.983510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de27e9-6581-4249-9dcb-967fceb08689 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:27.996352 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-85de27e9-6581-4249-9dcb-967fceb08689 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 14:07:28.002409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 529/1084] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Apr 12 14:07:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:07:28.003638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8e0c6-cf14-41df-ab34-6c0eccf659bc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:28.104552 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8e0c6-cf14-41df-ab34-6c0eccf659bc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:28.140753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3208e-a3b5-4f24-8f76-e2995e5a61b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:28.141449 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3208e-a3b5-4f24-8f76-e2995e5a61b2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.141729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3208e-a3b5-4f24-8f76-e2995e5a61b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.141999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3208e-a3b5-4f24-8f76-e2995e5a61b2 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.142821 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3208e-a3b5-4f24-8f76-e2995e5a61b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:28.143133 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3208e-a3b5-4f24-8f76-e2995e5a61b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:28.144556 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3208e-a3b5-4f24-8f76-e2995e5a61b2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:28.146095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093a44f-0f9b-406c-a9be-f28b49d9ff76 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.146522 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093a44f-0f9b-406c-a9be-f28b49d9ff76 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.146633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093a44f-0f9b-406c-a9be-f28b49d9ff76 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.148141 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 530/1085] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:07:28.152841 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ca17d-1e59-41cb-9723-fb9525a10072 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.153158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ca17d-1e59-41cb-9723-fb9525a10072 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.153433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ca17d-1e59-41cb-9723-fb9525a10072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.164390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 556/1086] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Apr 12 14:07:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:28.171152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3208e-a3b5-4f24-8f76-e2995e5a61b2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:28.172075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-604ca17d-1e59-41cb-9723-fb9525a10072 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:28.173300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-604ca17d-1e59-41cb-9723-fb9525a10072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:28.238829 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 531/1087] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:28.261462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ca17d-1e59-41cb-9723-fb9525a10072 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:28.268468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3208e-a3b5-4f24-8f76-e2995e5a61b2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:28.301432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef403c1e-d60d-493d-b470-8eb4d3925734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:28.302072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef403c1e-d60d-493d-b470-8eb4d3925734 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.302350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef403c1e-d60d-493d-b470-8eb4d3925734 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.302621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef403c1e-d60d-493d-b470-8eb4d3925734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.358616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ca17d-1e59-41cb-9723-fb9525a10072 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:28.368204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef403c1e-d60d-493d-b470-8eb4d3925734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:28.369663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef403c1e-d60d-493d-b470-8eb4d3925734 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:28.391956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47b03b-7b17-447f-aba3-372489028437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:28.392746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47b03b-7b17-447f-aba3-372489028437 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.393060 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47b03b-7b17-447f-aba3-372489028437 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.393341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47b03b-7b17-447f-aba3-372489028437 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.403065 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47b03b-7b17-447f-aba3-372489028437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:07:28.409935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-2f47b03b-7b17-447f-aba3-372489028437 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:07:28.411128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 532/1088] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:07:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:07:28.418254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47b03b-7b17-447f-aba3-372489028437 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:28.467209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 557/1089] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:07:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 14:07:28.472856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef403c1e-d60d-493d-b470-8eb4d3925734 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:28.516585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47b03b-7b17-447f-aba3-372489028437 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:28.548547 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c40cf6-5bea-43a3-8eb5-9fdcf8b147e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:28.549239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c40cf6-5bea-43a3-8eb5-9fdcf8b147e5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.549521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c40cf6-5bea-43a3-8eb5-9fdcf8b147e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.549796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c40cf6-5bea-43a3-8eb5-9fdcf8b147e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.550534 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c40cf6-5bea-43a3-8eb5-9fdcf8b147e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:28.550846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c40cf6-5bea-43a3-8eb5-9fdcf8b147e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:28.552254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c40cf6-5bea-43a3-8eb5-9fdcf8b147e5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:28.560546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 533/1090] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:28.565875 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef403c1e-d60d-493d-b470-8eb4d3925734 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:28.566718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c40cf6-5bea-43a3-8eb5-9fdcf8b147e5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:28.598718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055531f6-6bb4-4cc5-a66c-00c3565b5f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:28.599496 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055531f6-6bb4-4cc5-a66c-00c3565b5f72 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.599775 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055531f6-6bb4-4cc5-a66c-00c3565b5f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.600042 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055531f6-6bb4-4cc5-a66c-00c3565b5f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.610132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055531f6-6bb4-4cc5-a66c-00c3565b5f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:28.611565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055531f6-6bb4-4cc5-a66c-00c3565b5f72 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:28.629278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-055531f6-6bb4-4cc5-a66c-00c3565b5f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:07:28.630457 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 558/1091] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:07:28.636190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055531f6-6bb4-4cc5-a66c-00c3565b5f72 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:28.663051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c40cf6-5bea-43a3-8eb5-9fdcf8b147e5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:28.697542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41e2b-ad40-4cfc-aeac-73676561566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:28.698409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41e2b-ad40-4cfc-aeac-73676561566c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.698689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41e2b-ad40-4cfc-aeac-73676561566c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.698966 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41e2b-ad40-4cfc-aeac-73676561566c None admin] PATH_INFO: `/v3/users/37cff6e0d258481089ee9f6b7f109c62` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.700159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f41e2b-ad40-4cfc-aeac-73676561566c None admin] RBAC: Authorizing `identity:get_user(user_id=37cff6e0d258481089ee9f6b7f109c62)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:28.702311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f41e2b-ad40-4cfc-aeac-73676561566c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:28.703977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 534/1092] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:07:28 2022] GET /identity/v3/users/37cff6e0d258481089ee9f6b7f109c62 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:28.709732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41e2b-ad40-4cfc-aeac-73676561566c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:28.733144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055531f6-6bb4-4cc5-a66c-00c3565b5f72 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:28.766101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3ac8-3020-492a-ae70-0c1b291af4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:28.766820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3ac8-3020-492a-ae70-0c1b291af4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.767040 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3ac8-3020-492a-ae70-0c1b291af4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.767308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3ac8-3020-492a-ae70-0c1b291af4e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.768018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa3ac8-3020-492a-ae70-0c1b291af4e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:28.768322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa3ac8-3020-492a-ae70-0c1b291af4e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:28.769780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa3ac8-3020-492a-ae70-0c1b291af4e0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:28.780867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 559/1093] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:28.786562 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3ac8-3020-492a-ae70-0c1b291af4e0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:28.805415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41e2b-ad40-4cfc-aeac-73676561566c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:28.838457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d7cb2-3c8f-4478-802b-57570b6294df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:28.839380 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7cb2-3c8f-4478-802b-57570b6294df None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.839656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7cb2-3c8f-4478-802b-57570b6294df None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.839935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7cb2-3c8f-4478-802b-57570b6294df None admin] PATH_INFO: `/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.841140 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d7cb2-3c8f-4478-802b-57570b6294df None admin] RBAC: Authorizing `identity:get_project(project_id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:28.842704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d7cb2-3c8f-4478-802b-57570b6294df None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:28.844425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 535/1094] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:07:28 2022] GET /identity/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:28.850264 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d7cb2-3c8f-4478-802b-57570b6294df None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:28.881984 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3ac8-3020-492a-ae70-0c1b291af4e0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:28.914204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ee8d-4ede-4459-81e2-200607942f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:28.915018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ee8d-4ede-4459-81e2-200607942f68 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.915297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ee8d-4ede-4459-81e2-200607942f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.915564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ee8d-4ede-4459-81e2-200607942f68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.922755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331ee8d-4ede-4459-81e2-200607942f68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:28.924180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331ee8d-4ede-4459-81e2-200607942f68 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:28.938142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-4331ee8d-4ede-4459-81e2-200607942f68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:07:28.939320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 560/1095] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:07:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:07:28.945364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ee8d-4ede-4459-81e2-200607942f68 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:28.945940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d7cb2-3c8f-4478-802b-57570b6294df None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:28.977724 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a98f13-feac-4589-9095-417b2a866155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:28.978596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a98f13-feac-4589-9095-417b2a866155 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:28.978876 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a98f13-feac-4589-9095-417b2a866155 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:28.979143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a98f13-feac-4589-9095-417b2a866155 None admin] PATH_INFO: `/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1/users/37cff6e0d258481089ee9f6b7f109c62/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:28.981095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a98f13-feac-4589-9095-417b2a866155 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1, user_id=37cff6e0d258481089ee9f6b7f109c62, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:28.983128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a98f13-feac-4589-9095-417b2a866155 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:29.038998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ee8d-4ede-4459-81e2-200607942f68 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:29.057593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 536/1096] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:07:28 2022] PUT /identity/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1/users/37cff6e0d258481089ee9f6b7f109c62/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:07:29.073098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccf781-75de-4a02-ba7e-4bee617e1a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:29.073785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccf781-75de-4a02-ba7e-4bee617e1a48 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:29.074072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccf781-75de-4a02-ba7e-4bee617e1a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:29.079016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccf781-75de-4a02-ba7e-4bee617e1a48 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:29.079016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccf781-75de-4a02-ba7e-4bee617e1a48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:29.079016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccf781-75de-4a02-ba7e-4bee617e1a48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:29.079016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccf781-75de-4a02-ba7e-4bee617e1a48 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:29.090220 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 561/1097] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:07:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:29.097242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a98f13-feac-4589-9095-417b2a866155 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:29.203646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a98f13-feac-4589-9095-417b2a866155 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:29.242775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7e769-12ad-4170-9d6e-6ebf05a4797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:29.243436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7e769-12ad-4170-9d6e-6ebf05a4797e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:29.243724 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7e769-12ad-4170-9d6e-6ebf05a4797e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:29.244500 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7e769-12ad-4170-9d6e-6ebf05a4797e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:29.244819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7e769-12ad-4170-9d6e-6ebf05a4797e None admin] RBAC: Adding query filter params (role.id=ced9d7828d0e4de4b81ab8d0445331ea, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=b9933c6dc8f74cd59f6a1f8c11abf652) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:29.245152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7e769-12ad-4170-9d6e-6ebf05a4797e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:29.246573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7e769-12ad-4170-9d6e-6ebf05a4797e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:29.253862 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 537/1098] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:07:29 2022] GET /identity/v3/role_assignments?user.id=b9933c6dc8f74cd59f6a1f8c11abf652&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=ced9d7828d0e4de4b81ab8d0445331ea => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:31.407327 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83c50-c9a9-4d9c-a737-c287834488b6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:31.407860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83c50-c9a9-4d9c-a737-c287834488b6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:31.407860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83c50-c9a9-4d9c-a737-c287834488b6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:31.409257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 562/1099] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:31.414321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d60e8f-8b6e-4c85-a9b8-4257f75556a6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:31.414750 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d60e8f-8b6e-4c85-a9b8-4257f75556a6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:31.414881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d60e8f-8b6e-4c85-a9b8-4257f75556a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:31.431048 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-81d60e8f-8b6e-4c85-a9b8-4257f75556a6 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:31.432266 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-81d60e8f-8b6e-4c85-a9b8-4257f75556a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:31.494851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 538/1100] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:31.520405 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f83c50-c9a9-4d9c-a737-c287834488b6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:31.616542 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f83c50-c9a9-4d9c-a737-c287834488b6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:31.647766 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0694c24-46b9-4b0d-9af4-80602b8f00b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:31.648536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0694c24-46b9-4b0d-9af4-80602b8f00b0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:31.648815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0694c24-46b9-4b0d-9af4-80602b8f00b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:31.649116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0694c24-46b9-4b0d-9af4-80602b8f00b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:31.659336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0694c24-46b9-4b0d-9af4-80602b8f00b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:07:31.666094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-c0694c24-46b9-4b0d-9af4-80602b8f00b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:07:31.667273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 563/1101] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:07:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:31.674063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d60e8f-8b6e-4c85-a9b8-4257f75556a6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:31.768810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d60e8f-8b6e-4c85-a9b8-4257f75556a6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:31.801720 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9a836-5428-494f-8d8b-f8938a483872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:31.802399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a836-5428-494f-8d8b-f8938a483872 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:31.802683 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a836-5428-494f-8d8b-f8938a483872 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:31.802962 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a836-5428-494f-8d8b-f8938a483872 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:31.803709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9a836-5428-494f-8d8b-f8938a483872 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:31.804017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9a836-5428-494f-8d8b-f8938a483872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:31.805424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9a836-5428-494f-8d8b-f8938a483872 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:31.814076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 539/1102] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:31.820057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0694c24-46b9-4b0d-9af4-80602b8f00b0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:31.913916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0694c24-46b9-4b0d-9af4-80602b8f00b0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:31.948294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e14fe-3d34-4f14-971e-b93f4cc9237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:31.949172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e14fe-3d34-4f14-971e-b93f4cc9237d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:31.949453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e14fe-3d34-4f14-971e-b93f4cc9237d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:31.949726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e14fe-3d34-4f14-971e-b93f4cc9237d None admin] PATH_INFO: `/v3/users/37cff6e0d258481089ee9f6b7f109c62` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:31.950914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e14fe-3d34-4f14-971e-b93f4cc9237d None admin] RBAC: Authorizing `identity:get_user(user_id=37cff6e0d258481089ee9f6b7f109c62)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:31.952332 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e14fe-3d34-4f14-971e-b93f4cc9237d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:31.953995 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 564/1103] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:07:31 2022] GET /identity/v3/users/37cff6e0d258481089ee9f6b7f109c62 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:31.959748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9a836-5428-494f-8d8b-f8938a483872 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:32.055564 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9a836-5428-494f-8d8b-f8938a483872 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:32.087084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e83d7c-5fed-4dc9-b2c7-57452fa89802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:32.087715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e83d7c-5fed-4dc9-b2c7-57452fa89802 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:32.087994 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e83d7c-5fed-4dc9-b2c7-57452fa89802 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:32.088267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e83d7c-5fed-4dc9-b2c7-57452fa89802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:32.153243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e83d7c-5fed-4dc9-b2c7-57452fa89802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:32.155102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e83d7c-5fed-4dc9-b2c7-57452fa89802 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:32.246824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 540/1104] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:07:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:07:32.253335 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e14fe-3d34-4f14-971e-b93f4cc9237d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:32.348036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e14fe-3d34-4f14-971e-b93f4cc9237d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:32.382769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47849b-65c2-443b-a565-41e16cee7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:32.383624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47849b-65c2-443b-a565-41e16cee7d1f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:32.383903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47849b-65c2-443b-a565-41e16cee7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:32.384175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47849b-65c2-443b-a565-41e16cee7d1f None admin] PATH_INFO: `/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:32.385366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47849b-65c2-443b-a565-41e16cee7d1f None admin] RBAC: Authorizing `identity:get_project(project_id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:32.386780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47849b-65c2-443b-a565-41e16cee7d1f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:32.389370 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 565/1105] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:07:32 2022] GET /identity/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:32.395627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e83d7c-5fed-4dc9-b2c7-57452fa89802 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:32.504694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e83d7c-5fed-4dc9-b2c7-57452fa89802 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:32.537092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f26a-e14b-47d2-9901-4d5d35aaa463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:32.537735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f26a-e14b-47d2-9901-4d5d35aaa463 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:32.538014 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f26a-e14b-47d2-9901-4d5d35aaa463 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:32.538286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f26a-e14b-47d2-9901-4d5d35aaa463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:32.539104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f26a-e14b-47d2-9901-4d5d35aaa463 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1, user.id=37cff6e0d258481089ee9f6b7f109c62) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:32.539415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f26a-e14b-47d2-9901-4d5d35aaa463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:32.540934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f26a-e14b-47d2-9901-4d5d35aaa463 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:32.546997 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 541/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:07:32 2022] GET /identity/v3/role_assignments?user.id=37cff6e0d258481089ee9f6b7f109c62&scope.project.id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:34.853287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf55e-4f4c-4233-b961-ae1bd50b9080 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:34.853826 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf55e-4f4c-4233-b961-ae1bd50b9080 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:34.853826 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf55e-4f4c-4233-b961-ae1bd50b9080 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:34.855185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 566/1107] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:34.860530 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3488f4-408c-4b35-a9e6-95571944f128 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:34.860915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3488f4-408c-4b35-a9e6-95571944f128 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:34.861123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3488f4-408c-4b35-a9e6-95571944f128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:34.999806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5c3488f4-408c-4b35-a9e6-95571944f128 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:35.000934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5c3488f4-408c-4b35-a9e6-95571944f128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:35.065100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 542/1108] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:35.091511 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bf55e-4f4c-4233-b961-ae1bd50b9080 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:35.190693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bf55e-4f4c-4233-b961-ae1bd50b9080 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:35.223348 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ab2e5-32fa-4538-8cac-03ae739da99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:35.224126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ab2e5-32fa-4538-8cac-03ae739da99a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:35.224409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ab2e5-32fa-4538-8cac-03ae739da99a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:35.224682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ab2e5-32fa-4538-8cac-03ae739da99a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:35.225875 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ab2e5-32fa-4538-8cac-03ae739da99a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:35.227338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ab2e5-32fa-4538-8cac-03ae739da99a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:35.228972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 567/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:35.236789 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3488f4-408c-4b35-a9e6-95571944f128 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:35.334164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3488f4-408c-4b35-a9e6-95571944f128 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:35.366683 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa35085-19e3-486b-99cd-1f9bec2cedaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:35.367342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa35085-19e3-486b-99cd-1f9bec2cedaa None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:35.367625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa35085-19e3-486b-99cd-1f9bec2cedaa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:35.367901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa35085-19e3-486b-99cd-1f9bec2cedaa None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:35.368606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa35085-19e3-486b-99cd-1f9bec2cedaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:35.370119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa35085-19e3-486b-99cd-1f9bec2cedaa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:35.462579 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 543/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:07:35 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:07:37.841241 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc978b80-ba48-4884-b40b-7ac8e5510b98 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:37.841763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc978b80-ba48-4884-b40b-7ac8e5510b98 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:37.841763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc978b80-ba48-4884-b40b-7ac8e5510b98 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:37.843140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 568/1111] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:37.848385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad1bd-ab22-4547-bc42-5310ee559c37 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:37.848813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad1bd-ab22-4547-bc42-5310ee559c37 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:37.848941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad1bd-ab22-4547-bc42-5310ee559c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:37.865627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-53dad1bd-ab22-4547-bc42-5310ee559c37 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:37.866803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-53dad1bd-ab22-4547-bc42-5310ee559c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:37.931323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 544/1112] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:37.956754 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc978b80-ba48-4884-b40b-7ac8e5510b98 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:38.054426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc978b80-ba48-4884-b40b-7ac8e5510b98 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:38.085990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9807c26-168e-42c4-858c-ec084ac57b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:38.086832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9807c26-168e-42c4-858c-ec084ac57b4b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:38.087114 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9807c26-168e-42c4-858c-ec084ac57b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:38.087385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9807c26-168e-42c4-858c-ec084ac57b4b None admin] PATH_INFO: `/v3/roles/b227940c19244df2b57662537283a467` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:38.088828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9807c26-168e-42c4-858c-ec084ac57b4b None admin] RBAC: Authorizing `identity:get_role(role_id=b227940c19244df2b57662537283a467)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:38.090203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9807c26-168e-42c4-858c-ec084ac57b4b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:38.092488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 569/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:07:37 2022] GET /identity/v3/roles/b227940c19244df2b57662537283a467 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:38.098288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad1bd-ab22-4547-bc42-5310ee559c37 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:38.193374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad1bd-ab22-4547-bc42-5310ee559c37 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:38.226118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cced54a-08d0-412c-83e1-50adaa0d6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:38.227023 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cced54a-08d0-412c-83e1-50adaa0d6f43 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:38.227301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cced54a-08d0-412c-83e1-50adaa0d6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:38.227569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cced54a-08d0-412c-83e1-50adaa0d6f43 None admin] PATH_INFO: `/v3/users/f62f7b983cc4402b8f900613a1c1c8d7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:38.240298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cced54a-08d0-412c-83e1-50adaa0d6f43 None admin] RBAC: Authorizing `identity:get_user(user_id=f62f7b983cc4402b8f900613a1c1c8d7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:38.241781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cced54a-08d0-412c-83e1-50adaa0d6f43 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:38.243445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 545/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:07:38 2022] GET /identity/v3/users/f62f7b983cc4402b8f900613a1c1c8d7 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:38.249913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9807c26-168e-42c4-858c-ec084ac57b4b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:38.345281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9807c26-168e-42c4-858c-ec084ac57b4b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:38.377607 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6e60c-236f-4331-804d-44a5ab7eb828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:38.378246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e60c-236f-4331-804d-44a5ab7eb828 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:38.378526 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e60c-236f-4331-804d-44a5ab7eb828 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:38.378797 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e60c-236f-4331-804d-44a5ab7eb828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:38.441293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6e60c-236f-4331-804d-44a5ab7eb828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:38.442717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6e60c-236f-4331-804d-44a5ab7eb828 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:38.535548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 570/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:07:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 14:07:38.541453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cced54a-08d0-412c-83e1-50adaa0d6f43 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:38.636267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cced54a-08d0-412c-83e1-50adaa0d6f43 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:38.668054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619caed-6dbe-4ff7-a717-cc0b9c90afa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:38.669548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619caed-6dbe-4ff7-a717-cc0b9c90afa7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:38.669824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619caed-6dbe-4ff7-a717-cc0b9c90afa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:38.670096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619caed-6dbe-4ff7-a717-cc0b9c90afa7 None admin] PATH_INFO: `/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:38.671309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619caed-6dbe-4ff7-a717-cc0b9c90afa7 None admin] RBAC: Authorizing `identity:get_project(project_id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:38.672740 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619caed-6dbe-4ff7-a717-cc0b9c90afa7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:38.674449 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 546/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:07:38 2022] GET /identity/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:38.680619 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6e60c-236f-4331-804d-44a5ab7eb828 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:38.776413 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6e60c-236f-4331-804d-44a5ab7eb828 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:38.933966 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366d55b-62c7-43ea-bdcb-a62d0c819c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:38.935511 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366d55b-62c7-43ea-bdcb-a62d0c819c29 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:38.935813 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366d55b-62c7-43ea-bdcb-a62d0c819c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:38.936087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366d55b-62c7-43ea-bdcb-a62d0c819c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:38.936909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366d55b-62c7-43ea-bdcb-a62d0c819c29 None admin] RBAC: Adding query filter params (role.id=b227940c19244df2b57662537283a467, scope.project.id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1, user.id=f62f7b983cc4402b8f900613a1c1c8d7) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:38.937248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366d55b-62c7-43ea-bdcb-a62d0c819c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:38.938655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366d55b-62c7-43ea-bdcb-a62d0c819c29 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:38.944260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 571/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:07:38 2022] GET /identity/v3/role_assignments?user.id=f62f7b983cc4402b8f900613a1c1c8d7&scope.project.id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1&role.id=b227940c19244df2b57662537283a467 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:07:41.226087 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697e2d1-8690-47b3-ae4f-f0c124e71eab None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:41.226615 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697e2d1-8690-47b3-ae4f-f0c124e71eab None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:41.226615 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697e2d1-8690-47b3-ae4f-f0c124e71eab None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:41.227957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 547/1118] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:41.233471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54818628-1362-4882-b37c-c8203fb052f7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:41.233972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54818628-1362-4882-b37c-c8203fb052f7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:41.234069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54818628-1362-4882-b37c-c8203fb052f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:41.250557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-54818628-1362-4882-b37c-c8203fb052f7 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:41.251715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-54818628-1362-4882-b37c-c8203fb052f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:41.324791 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 572/1119] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:41.348523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697e2d1-8690-47b3-ae4f-f0c124e71eab None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:41.447091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697e2d1-8690-47b3-ae4f-f0c124e71eab None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:41.478299 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cd208-7708-440c-8dec-bd68151afffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:41.479069 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cd208-7708-440c-8dec-bd68151afffe None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:41.479347 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cd208-7708-440c-8dec-bd68151afffe None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:41.479616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cd208-7708-440c-8dec-bd68151afffe None admin] PATH_INFO: `/v3/roles/b227940c19244df2b57662537283a467` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:41.481576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cd208-7708-440c-8dec-bd68151afffe None admin] RBAC: Authorizing `identity:get_role(role_id=b227940c19244df2b57662537283a467)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:41.482962 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cd208-7708-440c-8dec-bd68151afffe None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:41.484290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 548/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:07:41 2022] GET /identity/v3/roles/b227940c19244df2b57662537283a467 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:41.490062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54818628-1362-4882-b37c-c8203fb052f7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:41.583936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54818628-1362-4882-b37c-c8203fb052f7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:41.616101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4fa13-9db4-4efe-b688-779ba6a0f19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:41.616994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4fa13-9db4-4efe-b688-779ba6a0f19d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:41.617271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4fa13-9db4-4efe-b688-779ba6a0f19d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:41.617544 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4fa13-9db4-4efe-b688-779ba6a0f19d None admin] PATH_INFO: `/v3/users/f62f7b983cc4402b8f900613a1c1c8d7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:41.618741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4fa13-9db4-4efe-b688-779ba6a0f19d None admin] RBAC: Authorizing `identity:get_user(user_id=f62f7b983cc4402b8f900613a1c1c8d7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:41.620194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4fa13-9db4-4efe-b688-779ba6a0f19d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:41.622728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 573/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:07:41 2022] GET /identity/v3/users/f62f7b983cc4402b8f900613a1c1c8d7 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:41.628489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cd208-7708-440c-8dec-bd68151afffe None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:41.726392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cd208-7708-440c-8dec-bd68151afffe None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:41.758500 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20132fde-5f78-45cd-b6a9-ee9596a238fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:41.759293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20132fde-5f78-45cd-b6a9-ee9596a238fc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:41.759573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20132fde-5f78-45cd-b6a9-ee9596a238fc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:41.759845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20132fde-5f78-45cd-b6a9-ee9596a238fc None admin] PATH_INFO: `/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:41.761042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20132fde-5f78-45cd-b6a9-ee9596a238fc None admin] RBAC: Authorizing `identity:get_project(project_id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:41.762612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20132fde-5f78-45cd-b6a9-ee9596a238fc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:41.764286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 549/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:07:41 2022] GET /identity/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:41.771665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4fa13-9db4-4efe-b688-779ba6a0f19d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:41.866202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4fa13-9db4-4efe-b688-779ba6a0f19d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:41.897758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22a280-1bd5-4828-92c6-39e11cc7aba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:41.898632 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22a280-1bd5-4828-92c6-39e11cc7aba8 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:41.898915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22a280-1bd5-4828-92c6-39e11cc7aba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:41.899193 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22a280-1bd5-4828-92c6-39e11cc7aba8 None admin] PATH_INFO: `/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1/users/f62f7b983cc4402b8f900613a1c1c8d7/roles/b227940c19244df2b57662537283a467` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:41.901426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22a280-1bd5-4828-92c6-39e11cc7aba8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1, user_id=f62f7b983cc4402b8f900613a1c1c8d7, role_id=b227940c19244df2b57662537283a467)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:41.902830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22a280-1bd5-4828-92c6-39e11cc7aba8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:41.980624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 574/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:07:41 2022] PUT /identity/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1/users/f62f7b983cc4402b8f900613a1c1c8d7/roles/b227940c19244df2b57662537283a467 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:07:44.230578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d81da3-313a-41e3-b74d-732c159bb3b6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:44.231160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d81da3-313a-41e3-b74d-732c159bb3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:44.231160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d81da3-313a-41e3-b74d-732c159bb3b6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:44.233157 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 550/1124] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:44.238439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc5a37-3e00-4fee-b2a4-0e58daaf914e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:44.238846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc5a37-3e00-4fee-b2a4-0e58daaf914e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:44.238992 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc5a37-3e00-4fee-b2a4-0e58daaf914e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:44.254915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d8fc5a37-3e00-4fee-b2a4-0e58daaf914e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:44.256101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d8fc5a37-3e00-4fee-b2a4-0e58daaf914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:44.323865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 575/1125] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:44.350157 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d81da3-313a-41e3-b74d-732c159bb3b6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:44.445353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d81da3-313a-41e3-b74d-732c159bb3b6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:44.477492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d9d7b-960c-4379-b301-6dd41db8b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:44.478316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d9d7b-960c-4379-b301-6dd41db8b3aa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:44.478596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d9d7b-960c-4379-b301-6dd41db8b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:44.478870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d9d7b-960c-4379-b301-6dd41db8b3aa None admin] PATH_INFO: `/v3/roles/b227940c19244df2b57662537283a467` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:44.480315 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d9d7b-960c-4379-b301-6dd41db8b3aa None admin] RBAC: Authorizing `identity:get_role(role_id=b227940c19244df2b57662537283a467)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:44.482315 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d9d7b-960c-4379-b301-6dd41db8b3aa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:44.483596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 551/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:07:44 2022] GET /identity/v3/roles/b227940c19244df2b57662537283a467 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:44.489452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc5a37-3e00-4fee-b2a4-0e58daaf914e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:44.582387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc5a37-3e00-4fee-b2a4-0e58daaf914e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:44.618733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fa051-995d-494f-bd79-309d7615e306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:44.619608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fa051-995d-494f-bd79-309d7615e306 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:44.619893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fa051-995d-494f-bd79-309d7615e306 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:44.620170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fa051-995d-494f-bd79-309d7615e306 None admin] PATH_INFO: `/v3/users/f62f7b983cc4402b8f900613a1c1c8d7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:44.621743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fa051-995d-494f-bd79-309d7615e306 None admin] RBAC: Authorizing `identity:get_user(user_id=f62f7b983cc4402b8f900613a1c1c8d7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:44.623406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fa051-995d-494f-bd79-309d7615e306 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:44.625134 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 576/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:07:44 2022] GET /identity/v3/users/f62f7b983cc4402b8f900613a1c1c8d7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:44.631062 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d9d7b-960c-4379-b301-6dd41db8b3aa None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:44.725210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d9d7b-960c-4379-b301-6dd41db8b3aa None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:44.763182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8e2b3-70bf-4f2a-a5e4-9f8c4708ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:44.763740 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8e2b3-70bf-4f2a-a5e4-9f8c4708ef8c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:44.764018 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8e2b3-70bf-4f2a-a5e4-9f8c4708ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:44.764288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8e2b3-70bf-4f2a-a5e4-9f8c4708ef8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:44.827976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8e2b3-70bf-4f2a-a5e4-9f8c4708ef8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:44.829356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8e2b3-70bf-4f2a-a5e4-9f8c4708ef8c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:44.920151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 552/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:07:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:07:44.926039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fa051-995d-494f-bd79-309d7615e306 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:45.020905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fa051-995d-494f-bd79-309d7615e306 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:45.054382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955b963-054e-4ba7-b785-7158f7810c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:45.055320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b963-054e-4ba7-b785-7158f7810c0c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:45.055599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b963-054e-4ba7-b785-7158f7810c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:45.055871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b963-054e-4ba7-b785-7158f7810c0c None admin] PATH_INFO: `/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:45.057055 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955b963-054e-4ba7-b785-7158f7810c0c None admin] RBAC: Authorizing `identity:get_project(project_id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:45.058472 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955b963-054e-4ba7-b785-7158f7810c0c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:45.060204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 577/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:07:44 2022] GET /identity/v3/projects/7bbe4dc5dffe4a8ca77b31fe1f5a1fe1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:45.066416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8e2b3-70bf-4f2a-a5e4-9f8c4708ef8c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:45.160836 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8e2b3-70bf-4f2a-a5e4-9f8c4708ef8c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:45.192044 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2818c73-dbac-40c1-8f3f-90b94c4bf960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:45.192711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2818c73-dbac-40c1-8f3f-90b94c4bf960 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:45.193011 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2818c73-dbac-40c1-8f3f-90b94c4bf960 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:45.193291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2818c73-dbac-40c1-8f3f-90b94c4bf960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:45.194372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2818c73-dbac-40c1-8f3f-90b94c4bf960 None admin] RBAC: Adding query filter params (role.id=b227940c19244df2b57662537283a467, scope.project.id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1, user.id=f62f7b983cc4402b8f900613a1c1c8d7) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:45.194710 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2818c73-dbac-40c1-8f3f-90b94c4bf960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:45.196133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2818c73-dbac-40c1-8f3f-90b94c4bf960 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:45.202286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 553/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:07:45 2022] GET /identity/v3/role_assignments?user.id=f62f7b983cc4402b8f900613a1c1c8d7&scope.project.id=7bbe4dc5dffe4a8ca77b31fe1f5a1fe1&role.id=b227940c19244df2b57662537283a467 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:47.494910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcfcfc-5846-462d-a1ca-70915af9a051 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:47.495490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcfcfc-5846-462d-a1ca-70915af9a051 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:47.495490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcfcfc-5846-462d-a1ca-70915af9a051 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:47.497445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 578/1131] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:47.503189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dee8-00dc-42dc-9612-1d17133d13ca None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:47.503592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dee8-00dc-42dc-9612-1d17133d13ca None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:47.503785 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dee8-00dc-42dc-9612-1d17133d13ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:47.520923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a8a6dee8-00dc-42dc-9612-1d17133d13ca None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:47.522132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a8a6dee8-00dc-42dc-9612-1d17133d13ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:47.586294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 554/1132] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:47.611966 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcfcfc-5846-462d-a1ca-70915af9a051 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:47.716874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcfcfc-5846-462d-a1ca-70915af9a051 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:47.750252 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ef338-b79a-4826-b910-472bf6886a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:47.751053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ef338-b79a-4826-b910-472bf6886a44 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:47.751336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ef338-b79a-4826-b910-472bf6886a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:47.751611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ef338-b79a-4826-b910-472bf6886a44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:47.752785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ef338-b79a-4826-b910-472bf6886a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:47.754243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ef338-b79a-4826-b910-472bf6886a44 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:47.755842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 579/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:47.761677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6dee8-00dc-42dc-9612-1d17133d13ca None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:47.854110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6dee8-00dc-42dc-9612-1d17133d13ca None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:47.887477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82472d86-9309-4081-955f-5660f2890400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:47.888359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472d86-9309-4081-955f-5660f2890400 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:47.888639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472d86-9309-4081-955f-5660f2890400 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:47.888929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472d86-9309-4081-955f-5660f2890400 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:47.889639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82472d86-9309-4081-955f-5660f2890400 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:47.891050 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82472d86-9309-4081-955f-5660f2890400 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:47.994934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 555/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:07:47 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:07:50.354640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb8254-1264-4954-8640-d9ace9f9f59a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:50.355203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb8254-1264-4954-8640-d9ace9f9f59a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:50.355203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb8254-1264-4954-8640-d9ace9f9f59a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:50.357187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 580/1135] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:50.362486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac8ab-6008-4db3-836b-1f8bc35b9ce1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:50.362910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac8ab-6008-4db3-836b-1f8bc35b9ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:50.363039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac8ab-6008-4db3-836b-1f8bc35b9ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:50.379878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0ffac8ab-6008-4db3-836b-1f8bc35b9ce1 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:50.381212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0ffac8ab-6008-4db3-836b-1f8bc35b9ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:50.444523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 556/1136] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:50.470724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb8254-1264-4954-8640-d9ace9f9f59a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:50.568899 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb8254-1264-4954-8640-d9ace9f9f59a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:50.600418 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e17137-99dd-4d2e-9ded-5e7c9d3782a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:50.601225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e17137-99dd-4d2e-9ded-5e7c9d3782a3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:50.601511 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e17137-99dd-4d2e-9ded-5e7c9d3782a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:50.601785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e17137-99dd-4d2e-9ded-5e7c9d3782a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:50.603023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e17137-99dd-4d2e-9ded-5e7c9d3782a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:50.604438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e17137-99dd-4d2e-9ded-5e7c9d3782a3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:50.606634 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 581/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:07:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:50.612687 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffac8ab-6008-4db3-836b-1f8bc35b9ce1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:50.706086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffac8ab-6008-4db3-836b-1f8bc35b9ce1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:50.738940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdeda30-ee06-4af6-be35-a34f20223cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:50.739596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdeda30-ee06-4af6-be35-a34f20223cd3 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:50.739935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdeda30-ee06-4af6-be35-a34f20223cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:50.740211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdeda30-ee06-4af6-be35-a34f20223cd3 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:50.740919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdeda30-ee06-4af6-be35-a34f20223cd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:50.742366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdeda30-ee06-4af6-be35-a34f20223cd3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:50.826998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 557/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:07:50 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:07:53.177507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5c84-31ab-4060-9ece-10a89172b5bd None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:53.178046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5c84-31ab-4060-9ece-10a89172b5bd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:53.178046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5c84-31ab-4060-9ece-10a89172b5bd None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:53.179471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 582/1139] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:53.185239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6a77-b38b-4fca-ac29-5fd4d71e88da None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:53.185622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6a77-b38b-4fca-ac29-5fd4d71e88da None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:53.185790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6a77-b38b-4fca-ac29-5fd4d71e88da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:53.202609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e08b6a77-b38b-4fca-ac29-5fd4d71e88da None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:53.203772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e08b6a77-b38b-4fca-ac29-5fd4d71e88da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:53.265857 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 558/1140] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:07:53.291237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db5c84-31ab-4060-9ece-10a89172b5bd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:53.387746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db5c84-31ab-4060-9ece-10a89172b5bd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:53.420140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3aa8a-3d58-4e97-af27-639b50b1f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:53.420916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3aa8a-3d58-4e97-af27-639b50b1f263 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:53.421226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3aa8a-3d58-4e97-af27-639b50b1f263 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:53.421496 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3aa8a-3d58-4e97-af27-639b50b1f263 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:53.430999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3aa8a-3d58-4e97-af27-639b50b1f263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:07:53.438230 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-99e3aa8a-3d58-4e97-af27-639b50b1f263 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:07:53.439385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 583/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:07:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:53.445727 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b6a77-b38b-4fca-ac29-5fd4d71e88da None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:53.536032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b6a77-b38b-4fca-ac29-5fd4d71e88da None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:53.567346 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e983580-8bdf-47e8-9774-ba0f3274166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:53.567978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e983580-8bdf-47e8-9774-ba0f3274166e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:53.568512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e983580-8bdf-47e8-9774-ba0f3274166e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:53.568785 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e983580-8bdf-47e8-9774-ba0f3274166e None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:53.569537 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e983580-8bdf-47e8-9774-ba0f3274166e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:53.569840 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e983580-8bdf-47e8-9774-ba0f3274166e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:53.571191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e983580-8bdf-47e8-9774-ba0f3274166e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:53.579270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 559/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:07:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:53.585012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3aa8a-3d58-4e97-af27-639b50b1f263 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:53.684609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3aa8a-3d58-4e97-af27-639b50b1f263 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:53.717404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a627b-ad17-4009-ae47-8bf0c5d56d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:53.718260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a627b-ad17-4009-ae47-8bf0c5d56d02 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:53.718544 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a627b-ad17-4009-ae47-8bf0c5d56d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:53.718818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a627b-ad17-4009-ae47-8bf0c5d56d02 None admin] PATH_INFO: `/v3/users/e79f6146ece943bca4ccbdc058058b2a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:53.731402 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a627b-ad17-4009-ae47-8bf0c5d56d02 None admin] RBAC: Authorizing `identity:get_user(user_id=e79f6146ece943bca4ccbdc058058b2a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:53.732830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a627b-ad17-4009-ae47-8bf0c5d56d02 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:53.734505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 584/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:07:53 2022] GET /identity/v3/users/e79f6146ece943bca4ccbdc058058b2a => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:53.740427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e983580-8bdf-47e8-9774-ba0f3274166e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:53.836054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e983580-8bdf-47e8-9774-ba0f3274166e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:53.868431 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4429fe-8a4f-4bc1-94bd-18401b160b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:53.869086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4429fe-8a4f-4bc1-94bd-18401b160b33 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:53.869366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4429fe-8a4f-4bc1-94bd-18401b160b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:53.869635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4429fe-8a4f-4bc1-94bd-18401b160b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:53.932276 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4429fe-8a4f-4bc1-94bd-18401b160b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:53.934189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4429fe-8a4f-4bc1-94bd-18401b160b33 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:54.025548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 560/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:07:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:07:54.032072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a627b-ad17-4009-ae47-8bf0c5d56d02 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:54.126398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a627b-ad17-4009-ae47-8bf0c5d56d02 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:54.157936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a43c0d-19a7-4752-b848-47ad3269d524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:54.158782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a43c0d-19a7-4752-b848-47ad3269d524 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:54.159059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a43c0d-19a7-4752-b848-47ad3269d524 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:54.159331 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a43c0d-19a7-4752-b848-47ad3269d524 None admin] PATH_INFO: `/v3/projects/0821b70d9ffa4f61ad989b1830990b60` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:54.160479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a43c0d-19a7-4752-b848-47ad3269d524 None admin] RBAC: Authorizing `identity:get_project(project_id=0821b70d9ffa4f61ad989b1830990b60)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:54.161919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a43c0d-19a7-4752-b848-47ad3269d524 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:54.163582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 585/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:07:54 2022] GET /identity/v3/projects/0821b70d9ffa4f61ad989b1830990b60 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:54.170225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4429fe-8a4f-4bc1-94bd-18401b160b33 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:54.262468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4429fe-8a4f-4bc1-94bd-18401b160b33 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:54.294199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239cb3f-6e5b-4a4f-8413-49f5e92700d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:54.294773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239cb3f-6e5b-4a4f-8413-49f5e92700d5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:54.295054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239cb3f-6e5b-4a4f-8413-49f5e92700d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:54.295327 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239cb3f-6e5b-4a4f-8413-49f5e92700d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:54.296146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239cb3f-6e5b-4a4f-8413-49f5e92700d5 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=0821b70d9ffa4f61ad989b1830990b60, user.id=e79f6146ece943bca4ccbdc058058b2a) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:54.296456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239cb3f-6e5b-4a4f-8413-49f5e92700d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:54.297889 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239cb3f-6e5b-4a4f-8413-49f5e92700d5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:54.303014 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 561/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:07:54 2022] GET /identity/v3/role_assignments?user.id=e79f6146ece943bca4ccbdc058058b2a&scope.project.id=0821b70d9ffa4f61ad989b1830990b60&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:56.615239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cccd1-0f75-4b1d-8212-ff28f46c319a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:56.615830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cccd1-0f75-4b1d-8212-ff28f46c319a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:56.615830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cccd1-0f75-4b1d-8212-ff28f46c319a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:56.617287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 586/1147] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:56.622825 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b0f36-83e2-44d3-8b35-24db4d5d7b84 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:56.623263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b0f36-83e2-44d3-8b35-24db4d5d7b84 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:56.623372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b0f36-83e2-44d3-8b35-24db4d5d7b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:56.640496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b29b0f36-83e2-44d3-8b35-24db4d5d7b84 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:56.641698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b29b0f36-83e2-44d3-8b35-24db4d5d7b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:07:56.706001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 562/1148] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:07:56.729353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cccd1-0f75-4b1d-8212-ff28f46c319a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:56.832262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cccd1-0f75-4b1d-8212-ff28f46c319a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:56.865987 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ef2e-2e4b-4f92-9110-c7ef69898337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:56.866692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ef2e-2e4b-4f92-9110-c7ef69898337 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:56.866971 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ef2e-2e4b-4f92-9110-c7ef69898337 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:56.867242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ef2e-2e4b-4f92-9110-c7ef69898337 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:56.877650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281ef2e-2e4b-4f92-9110-c7ef69898337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:07:56.884344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-8281ef2e-2e4b-4f92-9110-c7ef69898337 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:07:56.885554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 587/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:07:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:07:56.893622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b0f36-83e2-44d3-8b35-24db4d5d7b84 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:56.987234 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b0f36-83e2-44d3-8b35-24db4d5d7b84 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:57.020400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a0133-53df-4da9-9d99-7327dd99c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:57.021088 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0133-53df-4da9-9d99-7327dd99c6aa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:57.021366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0133-53df-4da9-9d99-7327dd99c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:57.021635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0133-53df-4da9-9d99-7327dd99c6aa None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:57.022363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a0133-53df-4da9-9d99-7327dd99c6aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:07:57.022669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a0133-53df-4da9-9d99-7327dd99c6aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:57.024023 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a0133-53df-4da9-9d99-7327dd99c6aa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:57.032083 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 563/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:07:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:57.037952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ef2e-2e4b-4f92-9110-c7ef69898337 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:57.134902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ef2e-2e4b-4f92-9110-c7ef69898337 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:57.165996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a89c8-9cb9-4986-9da8-ab403b4fd679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:57.166853 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a89c8-9cb9-4986-9da8-ab403b4fd679 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:57.167786 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a89c8-9cb9-4986-9da8-ab403b4fd679 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:57.168064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a89c8-9cb9-4986-9da8-ab403b4fd679 None admin] PATH_INFO: `/v3/users/e79f6146ece943bca4ccbdc058058b2a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:57.169523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a89c8-9cb9-4986-9da8-ab403b4fd679 None admin] RBAC: Authorizing `identity:get_user(user_id=e79f6146ece943bca4ccbdc058058b2a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:57.170955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a89c8-9cb9-4986-9da8-ab403b4fd679 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:57.172621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 588/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:07:57 2022] GET /identity/v3/users/e79f6146ece943bca4ccbdc058058b2a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:57.178685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a0133-53df-4da9-9d99-7327dd99c6aa None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:57.273132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a0133-53df-4da9-9d99-7327dd99c6aa None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:57.305123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbd6bb-f8d2-4b53-bfb8-976e459f154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:57.305983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbd6bb-f8d2-4b53-bfb8-976e459f154e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:57.306248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbd6bb-f8d2-4b53-bfb8-976e459f154e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:57.306522 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbd6bb-f8d2-4b53-bfb8-976e459f154e None admin] PATH_INFO: `/v3/projects/0821b70d9ffa4f61ad989b1830990b60` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:57.307690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbd6bb-f8d2-4b53-bfb8-976e459f154e None admin] RBAC: Authorizing `identity:get_project(project_id=0821b70d9ffa4f61ad989b1830990b60)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:57.309861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbd6bb-f8d2-4b53-bfb8-976e459f154e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:57.312371 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 564/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:07:57 2022] GET /identity/v3/projects/0821b70d9ffa4f61ad989b1830990b60 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:07:57.318643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a89c8-9cb9-4986-9da8-ab403b4fd679 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:07:57.416725 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a89c8-9cb9-4986-9da8-ab403b4fd679 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:07:57.451031 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90407f6-226e-43e3-9877-55b40080de7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:07:57.451947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90407f6-226e-43e3-9877-55b40080de7f None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:57.452190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90407f6-226e-43e3-9877-55b40080de7f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:57.452467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90407f6-226e-43e3-9877-55b40080de7f None admin] PATH_INFO: `/v3/projects/0821b70d9ffa4f61ad989b1830990b60/users/e79f6146ece943bca4ccbdc058058b2a/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:57.454465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90407f6-226e-43e3-9877-55b40080de7f None admin] RBAC: Authorizing `identity:create_grant(project_id=0821b70d9ffa4f61ad989b1830990b60, user_id=e79f6146ece943bca4ccbdc058058b2a, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:07:57.455898 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90407f6-226e-43e3-9877-55b40080de7f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:07:57.558861 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 589/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:07:57 2022] PUT /identity/v3/projects/0821b70d9ffa4f61ad989b1830990b60/users/e79f6146ece943bca4ccbdc058058b2a/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:07:59.931823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abc2a0-c0c1-4baf-83be-c9d25ac1ff79 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:59.932322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abc2a0-c0c1-4baf-83be-c9d25ac1ff79 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:59.932322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abc2a0-c0c1-4baf-83be-c9d25ac1ff79 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:59.933743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 565/1154] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:07:59.938877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af815e-60ef-4bed-98d3-4a38f63ae432 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:07:59.939261 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af815e-60ef-4bed-98d3-4a38f63ae432 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:07:59.939436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af815e-60ef-4bed-98d3-4a38f63ae432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:07:59.956002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-93af815e-60ef-4bed-98d3-4a38f63ae432 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:07:59.957207 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-93af815e-60ef-4bed-98d3-4a38f63ae432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:08:00.021602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 590/1155] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:07:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:08:00.046263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abc2a0-c0c1-4baf-83be-c9d25ac1ff79 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:00.142516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abc2a0-c0c1-4baf-83be-c9d25ac1ff79 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:00.174317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25081351-bf44-4423-bfdc-67ad9a9e4f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:00.175087 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25081351-bf44-4423-bfdc-67ad9a9e4f5c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:00.175368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25081351-bf44-4423-bfdc-67ad9a9e4f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:00.175640 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25081351-bf44-4423-bfdc-67ad9a9e4f5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:00.185779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25081351-bf44-4423-bfdc-67ad9a9e4f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:08:00.192507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-25081351-bf44-4423-bfdc-67ad9a9e4f5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:08:00.193956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 566/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:08:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:08:00.200279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af815e-60ef-4bed-98d3-4a38f63ae432 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:00.298035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af815e-60ef-4bed-98d3-4a38f63ae432 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:00.333386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97815898-8374-413a-9f4f-2209c0eaad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:00.334087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97815898-8374-413a-9f4f-2209c0eaad91 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:00.334372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97815898-8374-413a-9f4f-2209c0eaad91 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:00.334641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97815898-8374-413a-9f4f-2209c0eaad91 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:00.335373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97815898-8374-413a-9f4f-2209c0eaad91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:08:00.335677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97815898-8374-413a-9f4f-2209c0eaad91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:00.337051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97815898-8374-413a-9f4f-2209c0eaad91 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:00.345762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 591/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:08:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:00.352092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25081351-bf44-4423-bfdc-67ad9a9e4f5c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:00.451864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25081351-bf44-4423-bfdc-67ad9a9e4f5c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:00.485416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230db5f-5954-4ae7-875a-716a2bec0324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:00.486308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230db5f-5954-4ae7-875a-716a2bec0324 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:00.486702 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230db5f-5954-4ae7-875a-716a2bec0324 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:00.486975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230db5f-5954-4ae7-875a-716a2bec0324 None admin] PATH_INFO: `/v3/users/e79f6146ece943bca4ccbdc058058b2a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:00.488196 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230db5f-5954-4ae7-875a-716a2bec0324 None admin] RBAC: Authorizing `identity:get_user(user_id=e79f6146ece943bca4ccbdc058058b2a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:00.489652 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230db5f-5954-4ae7-875a-716a2bec0324 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:00.491266 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 567/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:08:00 2022] GET /identity/v3/users/e79f6146ece943bca4ccbdc058058b2a => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:00.497974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97815898-8374-413a-9f4f-2209c0eaad91 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:00.594486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97815898-8374-413a-9f4f-2209c0eaad91 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:00.626301 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6bd28-a136-4895-8118-72cfbba12fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:00.626935 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6bd28-a136-4895-8118-72cfbba12fab None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:00.627214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6bd28-a136-4895-8118-72cfbba12fab None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:00.627481 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6bd28-a136-4895-8118-72cfbba12fab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:00.691727 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6bd28-a136-4895-8118-72cfbba12fab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:00.693430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6bd28-a136-4895-8118-72cfbba12fab None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:00.785683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 592/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:08:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:08:00.791438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230db5f-5954-4ae7-875a-716a2bec0324 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:00.887589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230db5f-5954-4ae7-875a-716a2bec0324 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:00.919023 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a554aa-14bb-4ecc-9614-464cfebdb69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:00.919854 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a554aa-14bb-4ecc-9614-464cfebdb69d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:00.920133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a554aa-14bb-4ecc-9614-464cfebdb69d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:00.920406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a554aa-14bb-4ecc-9614-464cfebdb69d None admin] PATH_INFO: `/v3/projects/0821b70d9ffa4f61ad989b1830990b60` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:00.921580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a554aa-14bb-4ecc-9614-464cfebdb69d None admin] RBAC: Authorizing `identity:get_project(project_id=0821b70d9ffa4f61ad989b1830990b60)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:00.923023 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a554aa-14bb-4ecc-9614-464cfebdb69d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:00.924678 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 568/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:08:00 2022] GET /identity/v3/projects/0821b70d9ffa4f61ad989b1830990b60 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:00.930767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6bd28-a136-4895-8118-72cfbba12fab None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:01.023886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6bd28-a136-4895-8118-72cfbba12fab None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:01.056384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d702205-c194-45f8-bd14-d3a271ac5beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:01.056957 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702205-c194-45f8-bd14-d3a271ac5beb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:01.057266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702205-c194-45f8-bd14-d3a271ac5beb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:01.058203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702205-c194-45f8-bd14-d3a271ac5beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:01.059154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d702205-c194-45f8-bd14-d3a271ac5beb None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=0821b70d9ffa4f61ad989b1830990b60, user.id=e79f6146ece943bca4ccbdc058058b2a) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:08:01.059468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d702205-c194-45f8-bd14-d3a271ac5beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:01.060882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d702205-c194-45f8-bd14-d3a271ac5beb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:01.066574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 593/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:08:00 2022] GET /identity/v3/role_assignments?user.id=e79f6146ece943bca4ccbdc058058b2a&scope.project.id=0821b70d9ffa4f61ad989b1830990b60&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:03.419260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb12bec-26b6-4c9a-970d-920ea76283b9 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:03.419864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb12bec-26b6-4c9a-970d-920ea76283b9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:03.419864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb12bec-26b6-4c9a-970d-920ea76283b9 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:03.421248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 569/1162] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:08:03.426492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee7964-cc80-45b3-8f1e-7f968c0f6c8a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:03.426911 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee7964-cc80-45b3-8f1e-7f968c0f6c8a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:03.427033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee7964-cc80-45b3-8f1e-7f968c0f6c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:03.443416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f6ee7964-cc80-45b3-8f1e-7f968c0f6c8a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:08:03.444574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f6ee7964-cc80-45b3-8f1e-7f968c0f6c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:08:03.508255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 594/1163] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:08:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:08:03.530718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb12bec-26b6-4c9a-970d-920ea76283b9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:03.628791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb12bec-26b6-4c9a-970d-920ea76283b9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:03.660646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c74b8-9309-488e-87d4-52e7acf190bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:03.661322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c74b8-9309-488e-87d4-52e7acf190bd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:03.661604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c74b8-9309-488e-87d4-52e7acf190bd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:03.661877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c74b8-9309-488e-87d4-52e7acf190bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:03.726342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c74b8-9309-488e-87d4-52e7acf190bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:03.727702 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c74b8-9309-488e-87d4-52e7acf190bd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:03.819042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 570/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:08:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:08:03.827282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee7964-cc80-45b3-8f1e-7f968c0f6c8a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:03.922087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee7964-cc80-45b3-8f1e-7f968c0f6c8a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:03.954558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd634f8-2c88-4940-9604-41e4742085a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:03.955349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd634f8-2c88-4940-9604-41e4742085a2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:03.955635 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd634f8-2c88-4940-9604-41e4742085a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:03.955913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd634f8-2c88-4940-9604-41e4742085a2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:03.962316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd634f8-2c88-4940-9604-41e4742085a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:03.963798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd634f8-2c88-4940-9604-41e4742085a2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:03.986801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-ecd634f8-2c88-4940-9604-41e4742085a2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 12 14:08:03.986801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 595/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Apr 12 14:08:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:08:03.987108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c74b8-9309-488e-87d4-52e7acf190bd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:04.078370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c74b8-9309-488e-87d4-52e7acf190bd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:04.110288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10227611-9be8-44b3-94f7-da99287acf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:04.110927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227611-9be8-44b3-94f7-da99287acf6f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:04.111206 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227611-9be8-44b3-94f7-da99287acf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:04.111477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227611-9be8-44b3-94f7-da99287acf6f None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:04.112182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227611-9be8-44b3-94f7-da99287acf6f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:08:04.112484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227611-9be8-44b3-94f7-da99287acf6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:04.113866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227611-9be8-44b3-94f7-da99287acf6f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:04.121384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 571/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Apr 12 14:08:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:06.460102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1124-7bc9-420a-af06-be94396b2a30 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:06.460637 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1124-7bc9-420a-af06-be94396b2a30 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:06.460637 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1124-7bc9-420a-af06-be94396b2a30 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:06.462129 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 596/1167] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:08:06.468347 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df38c0-d113-482a-afc3-d282ce0dfd44 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:06.468770 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df38c0-d113-482a-afc3-d282ce0dfd44 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:06.468901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df38c0-d113-482a-afc3-d282ce0dfd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:06.484923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f9df38c0-d113-482a-afc3-d282ce0dfd44 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:08:06.486123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f9df38c0-d113-482a-afc3-d282ce0dfd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:08:06.552800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 572/1168] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:08:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:08:06.577796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a1124-7bc9-420a-af06-be94396b2a30 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:06.677868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a1124-7bc9-420a-af06-be94396b2a30 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:06.709748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249bace-dde8-47da-b440-1a226b902cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:06.710462 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249bace-dde8-47da-b440-1a226b902cc4 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:06.710690 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249bace-dde8-47da-b440-1a226b902cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:06.710970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249bace-dde8-47da-b440-1a226b902cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:06.711708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249bace-dde8-47da-b440-1a226b902cc4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:06.713080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249bace-dde8-47da-b440-1a226b902cc4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:06.866485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 597/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Tue Apr 12 14:08:06 2022] POST /identity/v3/domains => generated 267 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:08:09.178497 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726393f-2c76-4b5e-94c3-ab40d13f7738 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:09.179039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726393f-2c76-4b5e-94c3-ab40d13f7738 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:09.179039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726393f-2c76-4b5e-94c3-ab40d13f7738 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:09.180389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 573/1170] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:08:09.186135 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a234bc-b7bb-41ff-a75c-fd593ef1e81d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:09.186558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a234bc-b7bb-41ff-a75c-fd593ef1e81d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:09.186703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a234bc-b7bb-41ff-a75c-fd593ef1e81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:09.203232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f7a234bc-b7bb-41ff-a75c-fd593ef1e81d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:08:09.204458 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f7a234bc-b7bb-41ff-a75c-fd593ef1e81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:08:09.271562 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 598/1171] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:08:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:08:09.296683 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726393f-2c76-4b5e-94c3-ab40d13f7738 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:09.393241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726393f-2c76-4b5e-94c3-ab40d13f7738 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:09.425671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12178f10-bff4-4621-8127-7461f923d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:09.426515 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12178f10-bff4-4621-8127-7461f923d045 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:09.426791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12178f10-bff4-4621-8127-7461f923d045 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:09.427059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12178f10-bff4-4621-8127-7461f923d045 None admin] PATH_INFO: `/v3/domains/b5ba5b2672394fefb0af644b792ef2cd` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:09.437036 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12178f10-bff4-4621-8127-7461f923d045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b5ba5b2672394fefb0af644b792ef2cd)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:09.438422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12178f10-bff4-4621-8127-7461f923d045 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:09.440056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 574/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Tue Apr 12 14:08:09 2022] GET /identity/v3/domains/b5ba5b2672394fefb0af644b792ef2cd => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:09.446161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a234bc-b7bb-41ff-a75c-fd593ef1e81d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:09.538877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a234bc-b7bb-41ff-a75c-fd593ef1e81d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:09.571340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af243e5-7401-458f-b175-165b61860a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:09.571986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af243e5-7401-458f-b175-165b61860a09 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:09.572267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af243e5-7401-458f-b175-165b61860a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:09.572611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af243e5-7401-458f-b175-165b61860a09 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:09.573346 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af243e5-7401-458f-b175-165b61860a09 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:09.574752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af243e5-7401-458f-b175-165b61860a09 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:09.718297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 599/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:08:09 2022] POST /identity/v3/projects => generated 361 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:08:12.093503 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9915a-4f46-4967-aa22-500eb8fd1db4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:12.094003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9915a-4f46-4967-aa22-500eb8fd1db4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:12.094003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9915a-4f46-4967-aa22-500eb8fd1db4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:12.095302 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 575/1174] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:08:12.100559 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868cca7-4220-4b39-a573-371484d439a3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:12.100990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868cca7-4220-4b39-a573-371484d439a3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:12.101132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868cca7-4220-4b39-a573-371484d439a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:12.117473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0868cca7-4220-4b39-a573-371484d439a3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:08:12.118631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0868cca7-4220-4b39-a573-371484d439a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:08:12.183508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 600/1175] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:08:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:08:12.210333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9915a-4f46-4967-aa22-500eb8fd1db4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:12.307575 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9915a-4f46-4967-aa22-500eb8fd1db4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:12.339833 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338bbe3-c655-4a3d-bc56-2dbf83ed5623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:12.340666 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338bbe3-c655-4a3d-bc56-2dbf83ed5623 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:12.341000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338bbe3-c655-4a3d-bc56-2dbf83ed5623 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:12.341273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338bbe3-c655-4a3d-bc56-2dbf83ed5623 None admin] PATH_INFO: `/v3/domains/b5ba5b2672394fefb0af644b792ef2cd` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:12.342425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338bbe3-c655-4a3d-bc56-2dbf83ed5623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b5ba5b2672394fefb0af644b792ef2cd)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:12.343883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338bbe3-c655-4a3d-bc56-2dbf83ed5623 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:12.345440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 576/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Tue Apr 12 14:08:12 2022] GET /identity/v3/domains/b5ba5b2672394fefb0af644b792ef2cd => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:12.351320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868cca7-4220-4b39-a573-371484d439a3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:12.445611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868cca7-4220-4b39-a573-371484d439a3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:12.477362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee25960-a0bd-4c17-9476-71516ad096ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:12.478022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25960-a0bd-4c17-9476-71516ad096ba None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:12.478304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25960-a0bd-4c17-9476-71516ad096ba None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:12.479204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25960-a0bd-4c17-9476-71516ad096ba None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:12.479911 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee25960-a0bd-4c17-9476-71516ad096ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:12.481337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee25960-a0bd-4c17-9476-71516ad096ba None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:12.574845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 601/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:08:12 2022] POST /identity/v3/users => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:08:14.902938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d5fe-89d6-4c76-97f9-c162dfcbc1f0 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:14.903477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d5fe-89d6-4c76-97f9-c162dfcbc1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:14.903477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d5fe-89d6-4c76-97f9-c162dfcbc1f0 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:14.904812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 577/1178] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:08:14.909904 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b2b61-5ea5-4b0f-b028-a112a8a9d1bc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:14.910342 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b2b61-5ea5-4b0f-b028-a112a8a9d1bc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:14.910444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b2b61-5ea5-4b0f-b028-a112a8a9d1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:14.927330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6e9b2b61-5ea5-4b0f-b028-a112a8a9d1bc None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:08:14.928437 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6e9b2b61-5ea5-4b0f-b028-a112a8a9d1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:08:14.991006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 602/1179] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:08:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:08:15.015620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991d5fe-89d6-4c76-97f9-c162dfcbc1f0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:15.112720 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991d5fe-89d6-4c76-97f9-c162dfcbc1f0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:15.144385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2ce4b-9e64-42a2-a4c8-20b22ac4f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:15.145183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2ce4b-9e64-42a2-a4c8-20b22ac4f984 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:15.145461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2ce4b-9e64-42a2-a4c8-20b22ac4f984 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:15.145729 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2ce4b-9e64-42a2-a4c8-20b22ac4f984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:15.155783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2ce4b-9e64-42a2-a4c8-20b22ac4f984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:08:15.163540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-74a2ce4b-9e64-42a2-a4c8-20b22ac4f984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:08:15.164708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 578/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:08:15.170769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b2b61-5ea5-4b0f-b028-a112a8a9d1bc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:15.264806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b2b61-5ea5-4b0f-b028-a112a8a9d1bc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:15.298236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ac0fd-1987-426a-89b2-1a5ab6dbc43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:15.298908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ac0fd-1987-426a-89b2-1a5ab6dbc43a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:15.299192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ac0fd-1987-426a-89b2-1a5ab6dbc43a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:15.299564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ac0fd-1987-426a-89b2-1a5ab6dbc43a None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:15.300325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ac0fd-1987-426a-89b2-1a5ab6dbc43a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:08:15.300637 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ac0fd-1987-426a-89b2-1a5ab6dbc43a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:15.302320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ac0fd-1987-426a-89b2-1a5ab6dbc43a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:15.310697 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 603/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:08:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:15.316776 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2ce4b-9e64-42a2-a4c8-20b22ac4f984 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:15.416691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2ce4b-9e64-42a2-a4c8-20b22ac4f984 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:15.448354 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82caf2-c217-419d-85e0-a6353cba039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:15.449668 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82caf2-c217-419d-85e0-a6353cba039a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:15.449954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82caf2-c217-419d-85e0-a6353cba039a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:15.450221 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82caf2-c217-419d-85e0-a6353cba039a None admin] PATH_INFO: `/v3/users/d98b1a82cf7f4780890ae249c5eafd85` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:15.463633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82caf2-c217-419d-85e0-a6353cba039a None admin] RBAC: Authorizing `identity:get_user(user_id=d98b1a82cf7f4780890ae249c5eafd85)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:15.464803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82caf2-c217-419d-85e0-a6353cba039a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:15.466466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 579/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:08:15 2022] GET /identity/v3/users/d98b1a82cf7f4780890ae249c5eafd85 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:15.472689 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ac0fd-1987-426a-89b2-1a5ab6dbc43a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:15.569304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ac0fd-1987-426a-89b2-1a5ab6dbc43a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:15.600836 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe989f20-712f-4ab9-ae76-7d03df87fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:15.601654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe989f20-712f-4ab9-ae76-7d03df87fc6d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:15.601974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe989f20-712f-4ab9-ae76-7d03df87fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:15.602255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe989f20-712f-4ab9-ae76-7d03df87fc6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:15.667143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe989f20-712f-4ab9-ae76-7d03df87fc6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:15.668581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe989f20-712f-4ab9-ae76-7d03df87fc6d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:15.762691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 604/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:08:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:08:15.768829 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82caf2-c217-419d-85e0-a6353cba039a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:15.865945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82caf2-c217-419d-85e0-a6353cba039a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:15.897624 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129c95f-f2ee-43da-9388-22b6d2d0dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:15.898459 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129c95f-f2ee-43da-9388-22b6d2d0dee1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:15.898739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129c95f-f2ee-43da-9388-22b6d2d0dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:15.899010 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129c95f-f2ee-43da-9388-22b6d2d0dee1 None admin] PATH_INFO: `/v3/projects/16c30f1eadd04328ad757309687ec5a8` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:15.900255 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129c95f-f2ee-43da-9388-22b6d2d0dee1 None admin] RBAC: Authorizing `identity:get_project(project_id=16c30f1eadd04328ad757309687ec5a8)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:15.901737 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129c95f-f2ee-43da-9388-22b6d2d0dee1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:15.903407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 580/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:08:15 2022] GET /identity/v3/projects/16c30f1eadd04328ad757309687ec5a8 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:15.909544 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe989f20-712f-4ab9-ae76-7d03df87fc6d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:16.004081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe989f20-712f-4ab9-ae76-7d03df87fc6d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:16.036208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca59c-4a63-445b-9371-1003da089f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:16.036851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca59c-4a63-445b-9371-1003da089f79 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:16.037164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca59c-4a63-445b-9371-1003da089f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:16.037435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca59c-4a63-445b-9371-1003da089f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:16.038251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ca59c-4a63-445b-9371-1003da089f79 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=16c30f1eadd04328ad757309687ec5a8, user.id=d98b1a82cf7f4780890ae249c5eafd85) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:08:16.038559 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ca59c-4a63-445b-9371-1003da089f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:16.040011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ca59c-4a63-445b-9371-1003da089f79 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:16.046303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 605/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:08:15 2022] GET /identity/v3/role_assignments?user.id=d98b1a82cf7f4780890ae249c5eafd85&scope.project.id=16c30f1eadd04328ad757309687ec5a8&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:18.321267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2ec6b-b5fe-4949-aca2-9029d451974c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:18.321833 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2ec6b-b5fe-4949-aca2-9029d451974c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:18.321833 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2ec6b-b5fe-4949-aca2-9029d451974c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:18.323332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 581/1186] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:08:18.328500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186a5a-a4b1-44b9-a30a-64699d514a57 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:18.328922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186a5a-a4b1-44b9-a30a-64699d514a57 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:18.329080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186a5a-a4b1-44b9-a30a-64699d514a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:18.345114 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ce186a5a-a4b1-44b9-a30a-64699d514a57 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:08:18.346284 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ce186a5a-a4b1-44b9-a30a-64699d514a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:08:18.408208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 606/1187] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:08:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:08:18.432885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2ec6b-b5fe-4949-aca2-9029d451974c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:18.529474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2ec6b-b5fe-4949-aca2-9029d451974c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:18.562149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762fad-5b1c-4bba-91f8-6974523cafba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:18.562924 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762fad-5b1c-4bba-91f8-6974523cafba None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:18.563208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762fad-5b1c-4bba-91f8-6974523cafba None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:18.563483 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762fad-5b1c-4bba-91f8-6974523cafba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:18.573546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23762fad-5b1c-4bba-91f8-6974523cafba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:08:18.580238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-23762fad-5b1c-4bba-91f8-6974523cafba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:08:18.581433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 582/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:08:18.589334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce186a5a-a4b1-44b9-a30a-64699d514a57 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:18.683624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce186a5a-a4b1-44b9-a30a-64699d514a57 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:18.716356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef945d0-5a12-4928-82e0-fd6361025a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:18.717052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef945d0-5a12-4928-82e0-fd6361025a42 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:18.717340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef945d0-5a12-4928-82e0-fd6361025a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:18.717617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef945d0-5a12-4928-82e0-fd6361025a42 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:18.718353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef945d0-5a12-4928-82e0-fd6361025a42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:08:18.718662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef945d0-5a12-4928-82e0-fd6361025a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:18.720015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef945d0-5a12-4928-82e0-fd6361025a42 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:18.727780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 607/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:18.734126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762fad-5b1c-4bba-91f8-6974523cafba None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:18.828680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762fad-5b1c-4bba-91f8-6974523cafba None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:18.861548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5744eab-80f4-427c-8f13-fa1c9bc94caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:18.862403 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5744eab-80f4-427c-8f13-fa1c9bc94caa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:18.862682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5744eab-80f4-427c-8f13-fa1c9bc94caa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:18.862953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5744eab-80f4-427c-8f13-fa1c9bc94caa None admin] PATH_INFO: `/v3/users/d98b1a82cf7f4780890ae249c5eafd85` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:18.864126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5744eab-80f4-427c-8f13-fa1c9bc94caa None admin] RBAC: Authorizing `identity:get_user(user_id=d98b1a82cf7f4780890ae249c5eafd85)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:18.865583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5744eab-80f4-427c-8f13-fa1c9bc94caa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:18.867189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 583/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:08:18 2022] GET /identity/v3/users/d98b1a82cf7f4780890ae249c5eafd85 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:18.872951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef945d0-5a12-4928-82e0-fd6361025a42 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:18.968864 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef945d0-5a12-4928-82e0-fd6361025a42 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:19.000576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849563cc-399f-4d9b-b05e-3beb53f2e817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:19.001457 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849563cc-399f-4d9b-b05e-3beb53f2e817 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:19.001736 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849563cc-399f-4d9b-b05e-3beb53f2e817 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:19.002004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849563cc-399f-4d9b-b05e-3beb53f2e817 None admin] PATH_INFO: `/v3/projects/16c30f1eadd04328ad757309687ec5a8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:19.003158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849563cc-399f-4d9b-b05e-3beb53f2e817 None admin] RBAC: Authorizing `identity:get_project(project_id=16c30f1eadd04328ad757309687ec5a8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:19.004574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849563cc-399f-4d9b-b05e-3beb53f2e817 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:19.006291 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 608/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:08:18 2022] GET /identity/v3/projects/16c30f1eadd04328ad757309687ec5a8 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:19.012815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5744eab-80f4-427c-8f13-fa1c9bc94caa None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:19.108229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5744eab-80f4-427c-8f13-fa1c9bc94caa None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:19.140922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807894e6-d357-4994-8061-15069a318e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:19.141832 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807894e6-d357-4994-8061-15069a318e28 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:19.142113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807894e6-d357-4994-8061-15069a318e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:19.142383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807894e6-d357-4994-8061-15069a318e28 None admin] PATH_INFO: `/v3/projects/16c30f1eadd04328ad757309687ec5a8/users/d98b1a82cf7f4780890ae249c5eafd85/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:19.144314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807894e6-d357-4994-8061-15069a318e28 None admin] RBAC: Authorizing `identity:create_grant(project_id=16c30f1eadd04328ad757309687ec5a8, user_id=d98b1a82cf7f4780890ae249c5eafd85, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:19.145769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807894e6-d357-4994-8061-15069a318e28 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:19.213733 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 584/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:08:19 2022] PUT /identity/v3/projects/16c30f1eadd04328ad757309687ec5a8/users/d98b1a82cf7f4780890ae249c5eafd85/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:08:21.517991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6ce7-283a-4e32-9e58-41779bbd3064 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:21.518518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6ce7-283a-4e32-9e58-41779bbd3064 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:21.518634 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6ce7-283a-4e32-9e58-41779bbd3064 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:21.519959 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 609/1193] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:08:21.525326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a1f78-4ad8-46ce-bf80-7747d4972570 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:21.525714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a1f78-4ad8-46ce-bf80-7747d4972570 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:21.525882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a1f78-4ad8-46ce-bf80-7747d4972570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:21.542271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b62a1f78-4ad8-46ce-bf80-7747d4972570 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:08:21.543463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b62a1f78-4ad8-46ce-bf80-7747d4972570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:08:21.606408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 585/1194] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:08:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:08:21.633528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f6ce7-283a-4e32-9e58-41779bbd3064 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:21.732572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f6ce7-283a-4e32-9e58-41779bbd3064 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:21.765356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e976-9885-4749-ac69-c5ded4c0c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:21.766143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e976-9885-4749-ac69-c5ded4c0c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:21.766427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e976-9885-4749-ac69-c5ded4c0c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:21.766703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e976-9885-4749-ac69-c5ded4c0c9a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:21.776828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6e976-9885-4749-ac69-c5ded4c0c9a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:08:21.783628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-23d6e976-9885-4749-ac69-c5ded4c0c9a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:08:21.784868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 610/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:08:21.790883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a1f78-4ad8-46ce-bf80-7747d4972570 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:21.884346 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a1f78-4ad8-46ce-bf80-7747d4972570 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:21.915977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163349-a037-4710-9366-4992970511e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:21.916697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163349-a037-4710-9366-4992970511e9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:21.917004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163349-a037-4710-9366-4992970511e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:21.917280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163349-a037-4710-9366-4992970511e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:21.918021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4163349-a037-4710-9366-4992970511e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:08:21.918329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4163349-a037-4710-9366-4992970511e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:21.919723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4163349-a037-4710-9366-4992970511e9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:21.927311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 586/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:21.933636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e976-9885-4749-ac69-c5ded4c0c9a2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:22.027846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e976-9885-4749-ac69-c5ded4c0c9a2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:22.060913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55967d34-50c6-4735-b9bb-8729de517443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:22.061791 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55967d34-50c6-4735-b9bb-8729de517443 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:22.062076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55967d34-50c6-4735-b9bb-8729de517443 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:22.062355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55967d34-50c6-4735-b9bb-8729de517443 None admin] PATH_INFO: `/v3/users/d98b1a82cf7f4780890ae249c5eafd85` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:22.063531 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55967d34-50c6-4735-b9bb-8729de517443 None admin] RBAC: Authorizing `identity:get_user(user_id=d98b1a82cf7f4780890ae249c5eafd85)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:22.064957 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55967d34-50c6-4735-b9bb-8729de517443 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:22.066633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 611/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Apr 12 14:08:21 2022] GET /identity/v3/users/d98b1a82cf7f4780890ae249c5eafd85 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:22.072801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163349-a037-4710-9366-4992970511e9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:22.167092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163349-a037-4710-9366-4992970511e9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:22.198976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba4904-c1d6-4240-ac41-19b98c017794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:22.199619 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba4904-c1d6-4240-ac41-19b98c017794 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:22.199899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba4904-c1d6-4240-ac41-19b98c017794 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:22.200171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba4904-c1d6-4240-ac41-19b98c017794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:22.263763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba4904-c1d6-4240-ac41-19b98c017794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:22.265232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba4904-c1d6-4240-ac41-19b98c017794 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:22.358533 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 587/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:08:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:08:22.364570 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55967d34-50c6-4735-b9bb-8729de517443 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:22.462662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55967d34-50c6-4735-b9bb-8729de517443 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:22.499647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e860f8-f307-4779-81b9-84875d6f1313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:22.500488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e860f8-f307-4779-81b9-84875d6f1313 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:22.500775 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e860f8-f307-4779-81b9-84875d6f1313 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:22.501075 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e860f8-f307-4779-81b9-84875d6f1313 None admin] PATH_INFO: `/v3/projects/16c30f1eadd04328ad757309687ec5a8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:22.502258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e860f8-f307-4779-81b9-84875d6f1313 None admin] RBAC: Authorizing `identity:get_project(project_id=16c30f1eadd04328ad757309687ec5a8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:22.503692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e860f8-f307-4779-81b9-84875d6f1313 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:22.505408 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 612/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Apr 12 14:08:22 2022] GET /identity/v3/projects/16c30f1eadd04328ad757309687ec5a8 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:08:22.512351 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba4904-c1d6-4240-ac41-19b98c017794 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:08:22.608080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba4904-c1d6-4240-ac41-19b98c017794 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:08:22.640617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa607c0-f322-4287-8aeb-e4b45b0c13c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:08:22.641210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa607c0-f322-4287-8aeb-e4b45b0c13c6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:08:22.641494 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa607c0-f322-4287-8aeb-e4b45b0c13c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:08:22.641768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa607c0-f322-4287-8aeb-e4b45b0c13c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:08:22.642592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa607c0-f322-4287-8aeb-e4b45b0c13c6 None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=16c30f1eadd04328ad757309687ec5a8, user.id=d98b1a82cf7f4780890ae249c5eafd85) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:08:22.642900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa607c0-f322-4287-8aeb-e4b45b0c13c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:08:22.644315 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa607c0-f322-4287-8aeb-e4b45b0c13c6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:08:22.649992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 588/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:08:22 2022] GET /identity/v3/role_assignments?user.id=d98b1a82cf7f4780890ae249c5eafd85&scope.project.id=16c30f1eadd04328ad757309687ec5a8&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:44.312046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5c0e1-e1be-4d95-bfb8-ebdcd3b40d21 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:44.312755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5c0e1-e1be-4d95-bfb8-ebdcd3b40d21 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:44.312755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5c0e1-e1be-4d95-bfb8-ebdcd3b40d21 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:44.313976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 613/1201] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:09:44.319349 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d219-0c55-4c24-955b-272fc0ef8668 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:44.319791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d219-0c55-4c24-955b-272fc0ef8668 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:44.319903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d219-0c55-4c24-955b-272fc0ef8668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:44.336657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e8b1d219-0c55-4c24-955b-272fc0ef8668 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:09:44.337895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e8b1d219-0c55-4c24-955b-272fc0ef8668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:09:44.404742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 589/1202] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:09:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 14:09:44.430847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5c0e1-e1be-4d95-bfb8-ebdcd3b40d21 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:44.530107 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5c0e1-e1be-4d95-bfb8-ebdcd3b40d21 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:44.563823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96097097-9b64-445e-b2ca-136dab89cb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:44.564531 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96097097-9b64-445e-b2ca-136dab89cb2e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:44.564815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96097097-9b64-445e-b2ca-136dab89cb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:44.565119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96097097-9b64-445e-b2ca-136dab89cb2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:44.575407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96097097-9b64-445e-b2ca-136dab89cb2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:44.577131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96097097-9b64-445e-b2ca-136dab89cb2e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:44.594264 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-96097097-9b64-445e-b2ca-136dab89cb2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:09:44.595535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 614/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:44.601817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1d219-0c55-4c24-955b-272fc0ef8668 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:44.699693 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1d219-0c55-4c24-955b-272fc0ef8668 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:44.732797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0171e-0484-482d-8537-1dd4916dbd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:44.733513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0171e-0484-482d-8537-1dd4916dbd68 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:44.733792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0171e-0484-482d-8537-1dd4916dbd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:44.734063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0171e-0484-482d-8537-1dd4916dbd68 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:44.734782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0171e-0484-482d-8537-1dd4916dbd68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:44.735093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0171e-0484-482d-8537-1dd4916dbd68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:44.736454 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0171e-0484-482d-8537-1dd4916dbd68 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:44.747736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 590/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:44.753762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96097097-9b64-445e-b2ca-136dab89cb2e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:44.851341 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96097097-9b64-445e-b2ca-136dab89cb2e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:44.883520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389f2c2-81e6-4692-bce8-84d4b1827b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:44.884228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389f2c2-81e6-4692-bce8-84d4b1827b3d None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:44.884503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389f2c2-81e6-4692-bce8-84d4b1827b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:44.884773 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389f2c2-81e6-4692-bce8-84d4b1827b3d None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:44.885493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389f2c2-81e6-4692-bce8-84d4b1827b3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:44.887482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389f2c2-81e6-4692-bce8-84d4b1827b3d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:44.984230 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 615/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Apr 12 14:09:44 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:09:47.397403 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb447c4-bdb2-4a82-84ef-98d69f4ad559 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:47.398015 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb447c4-bdb2-4a82-84ef-98d69f4ad559 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:47.398122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb447c4-bdb2-4a82-84ef-98d69f4ad559 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:47.399453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 591/1206] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:09:47.405518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52b2ea-d137-46ba-bf84-bc7d9dc61e31 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:47.405945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52b2ea-d137-46ba-bf84-bc7d9dc61e31 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:47.406057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52b2ea-d137-46ba-bf84-bc7d9dc61e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:47.423933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cc52b2ea-d137-46ba-bf84-bc7d9dc61e31 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:09:47.425136 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cc52b2ea-d137-46ba-bf84-bc7d9dc61e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:09:47.493640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 616/1207] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:09:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:09:47.518279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb447c4-bdb2-4a82-84ef-98d69f4ad559 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:47.620478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb447c4-bdb2-4a82-84ef-98d69f4ad559 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:47.657287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf81c6e-f0af-4cac-b423-38f4a48fbc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:47.658043 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf81c6e-f0af-4cac-b423-38f4a48fbc4b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:47.658323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf81c6e-f0af-4cac-b423-38f4a48fbc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:47.658593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf81c6e-f0af-4cac-b423-38f4a48fbc4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:47.669551 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf81c6e-f0af-4cac-b423-38f4a48fbc4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:09:47.676589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-fcf81c6e-f0af-4cac-b423-38f4a48fbc4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:09:47.680793 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 592/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:09:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:47.683823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52b2ea-d137-46ba-bf84-bc7d9dc61e31 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:47.781552 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52b2ea-d137-46ba-bf84-bc7d9dc61e31 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:47.814054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a81c19-4c6a-4e40-add6-e335adbe3481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:47.814720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a81c19-4c6a-4e40-add6-e335adbe3481 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:47.814999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a81c19-4c6a-4e40-add6-e335adbe3481 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:47.815272 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a81c19-4c6a-4e40-add6-e335adbe3481 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:47.816014 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a81c19-4c6a-4e40-add6-e335adbe3481 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:47.816318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a81c19-4c6a-4e40-add6-e335adbe3481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:47.817767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a81c19-4c6a-4e40-add6-e335adbe3481 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:47.826520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 617/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:09:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:47.832373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf81c6e-f0af-4cac-b423-38f4a48fbc4b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:47.930853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf81c6e-f0af-4cac-b423-38f4a48fbc4b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:47.968389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285d152-e4e4-40ca-8d85-aab3ba3c4005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:47.969689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285d152-e4e4-40ca-8d85-aab3ba3c4005 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:47.970153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285d152-e4e4-40ca-8d85-aab3ba3c4005 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:47.970665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285d152-e4e4-40ca-8d85-aab3ba3c4005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:47.987874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285d152-e4e4-40ca-8d85-aab3ba3c4005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:47.990333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285d152-e4e4-40ca-8d85-aab3ba3c4005 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:48.020561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-0285d152-e4e4-40ca-8d85-aab3ba3c4005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:09:48.026168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 593/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:48.029783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a81c19-4c6a-4e40-add6-e335adbe3481 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:48.129617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a81c19-4c6a-4e40-add6-e335adbe3481 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:48.168048 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1d94-8f17-4d38-9764-437246641bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:48.168768 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1d94-8f17-4d38-9764-437246641bbc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:48.169138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1d94-8f17-4d38-9764-437246641bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:48.169417 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1d94-8f17-4d38-9764-437246641bbc None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:48.170144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1d94-8f17-4d38-9764-437246641bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:48.170453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1d94-8f17-4d38-9764-437246641bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:48.171824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1d94-8f17-4d38-9764-437246641bbc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:48.187192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 618/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:48.190155 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285d152-e4e4-40ca-8d85-aab3ba3c4005 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:48.289659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285d152-e4e4-40ca-8d85-aab3ba3c4005 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:48.322719 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e7635-216d-48e7-8fe7-47d8df9ea15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:48.323514 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e7635-216d-48e7-8fe7-47d8df9ea15a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:48.323795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e7635-216d-48e7-8fe7-47d8df9ea15a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:48.324068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e7635-216d-48e7-8fe7-47d8df9ea15a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:48.331454 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e7635-216d-48e7-8fe7-47d8df9ea15a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:48.332890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e7635-216d-48e7-8fe7-47d8df9ea15a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:48.346668 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-3b4e7635-216d-48e7-8fe7-47d8df9ea15a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 14:09:48.352996 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 594/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:09:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:48.354220 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1d94-8f17-4d38-9764-437246641bbc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:48.451790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1d94-8f17-4d38-9764-437246641bbc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:48.485806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c4bd-b719-4e1e-9cb7-7f3bd3e519bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:48.486479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c4bd-b719-4e1e-9cb7-7f3bd3e519bb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:48.486759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c4bd-b719-4e1e-9cb7-7f3bd3e519bb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:48.487030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c4bd-b719-4e1e-9cb7-7f3bd3e519bb None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:48.487863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c4bd-b719-4e1e-9cb7-7f3bd3e519bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:48.488168 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c4bd-b719-4e1e-9cb7-7f3bd3e519bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:48.489621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c4bd-b719-4e1e-9cb7-7f3bd3e519bb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:48.508449 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 619/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Apr 12 14:09:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:48.515187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e7635-216d-48e7-8fe7-47d8df9ea15a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:48.616855 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e7635-216d-48e7-8fe7-47d8df9ea15a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:48.649277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567966fd-3a81-4395-be71-5c705bbecfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:48.649969 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567966fd-3a81-4395-be71-5c705bbecfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:48.650247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567966fd-3a81-4395-be71-5c705bbecfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:48.650523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567966fd-3a81-4395-be71-5c705bbecfd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:48.715726 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567966fd-3a81-4395-be71-5c705bbecfd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:48.717105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567966fd-3a81-4395-be71-5c705bbecfd1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:48.808978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 595/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:09:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:09:48.814877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c4bd-b719-4e1e-9cb7-7f3bd3e519bb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:48.911304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c4bd-b719-4e1e-9cb7-7f3bd3e519bb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:48.944492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51806655-8df6-48ad-a542-0950f4d70fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:48.945311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806655-8df6-48ad-a542-0950f4d70fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:48.945599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806655-8df6-48ad-a542-0950f4d70fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:48.945877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806655-8df6-48ad-a542-0950f4d70fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:48.956179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51806655-8df6-48ad-a542-0950f4d70fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:48.957644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51806655-8df6-48ad-a542-0950f4d70fa4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:48.979446 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-51806655-8df6-48ad-a542-0950f4d70fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:09:48.979446 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 620/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:48.982033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567966fd-3a81-4395-be71-5c705bbecfd1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:49.076860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567966fd-3a81-4395-be71-5c705bbecfd1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:49.109550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed72fc-415d-4bb7-a0ee-5d0420341602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:49.110196 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed72fc-415d-4bb7-a0ee-5d0420341602 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:49.110474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed72fc-415d-4bb7-a0ee-5d0420341602 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:49.110786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed72fc-415d-4bb7-a0ee-5d0420341602 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:49.111487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed72fc-415d-4bb7-a0ee-5d0420341602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:49.111789 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed72fc-415d-4bb7-a0ee-5d0420341602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:49.113171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed72fc-415d-4bb7-a0ee-5d0420341602 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:49.125538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 596/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:49.131176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51806655-8df6-48ad-a542-0950f4d70fa4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:49.236227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51806655-8df6-48ad-a542-0950f4d70fa4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:49.269548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5df6e5-afba-4e87-a636-65cf839b9ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:49.270326 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5df6e5-afba-4e87-a636-65cf839b9ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:49.270604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5df6e5-afba-4e87-a636-65cf839b9ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:49.270875 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5df6e5-afba-4e87-a636-65cf839b9ca1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:49.277420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5df6e5-afba-4e87-a636-65cf839b9ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:49.278847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5df6e5-afba-4e87-a636-65cf839b9ca1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:49.291270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-cf5df6e5-afba-4e87-a636-65cf839b9ca1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:09:49.293017 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 621/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:09:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:49.299371 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed72fc-415d-4bb7-a0ee-5d0420341602 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:49.396250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed72fc-415d-4bb7-a0ee-5d0420341602 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:49.429082 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21c0b0-c276-4c1b-ad27-1d9d6ca524d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:49.429718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21c0b0-c276-4c1b-ad27-1d9d6ca524d5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:49.430000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21c0b0-c276-4c1b-ad27-1d9d6ca524d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:49.430283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21c0b0-c276-4c1b-ad27-1d9d6ca524d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:49.431079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21c0b0-c276-4c1b-ad27-1d9d6ca524d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:49.431367 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21c0b0-c276-4c1b-ad27-1d9d6ca524d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:49.432791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21c0b0-c276-4c1b-ad27-1d9d6ca524d5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:49.445556 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 597/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:09:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:49.451839 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5df6e5-afba-4e87-a636-65cf839b9ca1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:49.550842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5df6e5-afba-4e87-a636-65cf839b9ca1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:49.585277 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecf46c-ac24-4c6a-9d53-e07889801cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:49.585932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecf46c-ac24-4c6a-9d53-e07889801cfd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:49.586210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecf46c-ac24-4c6a-9d53-e07889801cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:49.586482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecf46c-ac24-4c6a-9d53-e07889801cfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:49.587300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecf46c-ac24-4c6a-9d53-e07889801cfd None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=3a7095f3ab8545c589d4d28a846ba1c0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:49.587609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecf46c-ac24-4c6a-9d53-e07889801cfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:49.589038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecf46c-ac24-4c6a-9d53-e07889801cfd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:49.595277 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 622/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:09:49 2022] GET /identity/v3/role_assignments?user.id=3a7095f3ab8545c589d4d28a846ba1c0&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:51.868264 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54a215-f286-4988-b2d2-ddae52d9ff67 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:51.868812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54a215-f286-4988-b2d2-ddae52d9ff67 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:51.868812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54a215-f286-4988-b2d2-ddae52d9ff67 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:51.870283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 598/1220] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:09:51.876475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca908-46cd-4154-ab1b-c44a43b31bc1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:51.876941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca908-46cd-4154-ab1b-c44a43b31bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:51.877086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca908-46cd-4154-ab1b-c44a43b31bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:51.896767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-39fca908-46cd-4154-ab1b-c44a43b31bc1 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:09:51.898060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-39fca908-46cd-4154-ab1b-c44a43b31bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:09:51.964814 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 623/1221] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:09:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:09:51.987263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54a215-f286-4988-b2d2-ddae52d9ff67 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:52.087721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54a215-f286-4988-b2d2-ddae52d9ff67 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:52.125356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf56a0d-ec42-42c5-b58b-d35740fc0190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:52.126142 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf56a0d-ec42-42c5-b58b-d35740fc0190 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:52.126421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf56a0d-ec42-42c5-b58b-d35740fc0190 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:52.126691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf56a0d-ec42-42c5-b58b-d35740fc0190 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:52.137613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf56a0d-ec42-42c5-b58b-d35740fc0190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:09:52.144709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-ebf56a0d-ec42-42c5-b58b-d35740fc0190 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:09:52.151618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 599/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:09:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:52.153474 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fca908-46cd-4154-ab1b-c44a43b31bc1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:52.248332 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fca908-46cd-4154-ab1b-c44a43b31bc1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:52.279928 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0470d1e-6c07-453b-866e-a2c7e5af9109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:52.280584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0470d1e-6c07-453b-866e-a2c7e5af9109 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:52.280867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0470d1e-6c07-453b-866e-a2c7e5af9109 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:52.281176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0470d1e-6c07-453b-866e-a2c7e5af9109 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:52.281907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0470d1e-6c07-453b-866e-a2c7e5af9109 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:52.282215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0470d1e-6c07-453b-866e-a2c7e5af9109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:52.283564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0470d1e-6c07-453b-866e-a2c7e5af9109 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:52.291099 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 624/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:09:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:09:52.297591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf56a0d-ec42-42c5-b58b-d35740fc0190 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:52.392875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf56a0d-ec42-42c5-b58b-d35740fc0190 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:52.424888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572c38-48cd-4955-9639-ec3d4dbde20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:52.425700 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572c38-48cd-4955-9639-ec3d4dbde20f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:52.425985 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572c38-48cd-4955-9639-ec3d4dbde20f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:52.426257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572c38-48cd-4955-9639-ec3d4dbde20f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:52.437186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb572c38-48cd-4955-9639-ec3d4dbde20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:52.438656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb572c38-48cd-4955-9639-ec3d4dbde20f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:52.455709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-cb572c38-48cd-4955-9639-ec3d4dbde20f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:09:52.456926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 600/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:52.462860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0470d1e-6c07-453b-866e-a2c7e5af9109 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:52.558340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0470d1e-6c07-453b-866e-a2c7e5af9109 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:52.592464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff445d-2ada-48f1-9b06-9d065da36d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:52.593157 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff445d-2ada-48f1-9b06-9d065da36d44 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:52.593933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff445d-2ada-48f1-9b06-9d065da36d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:52.593933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff445d-2ada-48f1-9b06-9d065da36d44 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:52.594400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff445d-2ada-48f1-9b06-9d065da36d44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:52.594699 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff445d-2ada-48f1-9b06-9d065da36d44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:52.596067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff445d-2ada-48f1-9b06-9d065da36d44 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:52.608190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 625/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:09:52.613980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572c38-48cd-4955-9639-ec3d4dbde20f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:52.717260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572c38-48cd-4955-9639-ec3d4dbde20f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:52.749261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e1a55-1e3b-4d34-9f76-631abee42acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:52.750084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1a55-1e3b-4d34-9f76-631abee42acc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:52.750363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1a55-1e3b-4d34-9f76-631abee42acc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:52.750635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1a55-1e3b-4d34-9f76-631abee42acc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:52.757822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e1a55-1e3b-4d34-9f76-631abee42acc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:52.759248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e1a55-1e3b-4d34-9f76-631abee42acc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:52.772403 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-6f9e1a55-1e3b-4d34-9f76-631abee42acc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 14:09:52.773581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 601/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:09:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:52.779998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff445d-2ada-48f1-9b06-9d065da36d44 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:52.875171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff445d-2ada-48f1-9b06-9d065da36d44 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:52.907971 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ba3ad-34a2-4022-8f09-586cf19c4493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:52.908635 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ba3ad-34a2-4022-8f09-586cf19c4493 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:52.908910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ba3ad-34a2-4022-8f09-586cf19c4493 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:52.909294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ba3ad-34a2-4022-8f09-586cf19c4493 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:52.910126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ba3ad-34a2-4022-8f09-586cf19c4493 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:52.910439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ba3ad-34a2-4022-8f09-586cf19c4493 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:52.911858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ba3ad-34a2-4022-8f09-586cf19c4493 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:52.928841 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 626/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Apr 12 14:09:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:52.934614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e1a55-1e3b-4d34-9f76-631abee42acc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:53.035486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e1a55-1e3b-4d34-9f76-631abee42acc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:53.067659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02aaf3c-0776-4758-bf22-f10cc2c81ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:53.068444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aaf3c-0776-4758-bf22-f10cc2c81ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:53.068983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aaf3c-0776-4758-bf22-f10cc2c81ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:53.069269 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aaf3c-0776-4758-bf22-f10cc2c81ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:53.079967 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02aaf3c-0776-4758-bf22-f10cc2c81ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:53.081448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02aaf3c-0776-4758-bf22-f10cc2c81ad7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:53.097460 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-e02aaf3c-0776-4758-bf22-f10cc2c81ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:09:53.098596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 602/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:53.104322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ba3ad-34a2-4022-8f09-586cf19c4493 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:53.200846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ba3ad-34a2-4022-8f09-586cf19c4493 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:53.235048 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae11cf4-0dc3-4b7e-874b-bc4f7a424dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:53.235760 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae11cf4-0dc3-4b7e-874b-bc4f7a424dfd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:53.236044 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae11cf4-0dc3-4b7e-874b-bc4f7a424dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:53.236318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae11cf4-0dc3-4b7e-874b-bc4f7a424dfd None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:53.237064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae11cf4-0dc3-4b7e-874b-bc4f7a424dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:53.237372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae11cf4-0dc3-4b7e-874b-bc4f7a424dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:53.241184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae11cf4-0dc3-4b7e-874b-bc4f7a424dfd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:53.250257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 627/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:53.256030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02aaf3c-0776-4758-bf22-f10cc2c81ad7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:53.359261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02aaf3c-0776-4758-bf22-f10cc2c81ad7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:53.392858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225affba-43a3-46e6-a3d2-9b74544c8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:53.393680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225affba-43a3-46e6-a3d2-9b74544c8566 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:53.393963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225affba-43a3-46e6-a3d2-9b74544c8566 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:53.394243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225affba-43a3-46e6-a3d2-9b74544c8566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:53.400946 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225affba-43a3-46e6-a3d2-9b74544c8566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:53.402711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225affba-43a3-46e6-a3d2-9b74544c8566 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:53.416242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-225affba-43a3-46e6-a3d2-9b74544c8566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:09:53.418749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 603/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:09:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:53.423914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae11cf4-0dc3-4b7e-874b-bc4f7a424dfd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:53.521488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae11cf4-0dc3-4b7e-874b-bc4f7a424dfd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:53.553576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d65f2f-902d-44be-ac66-06ca43871326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:53.554244 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d65f2f-902d-44be-ac66-06ca43871326 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:53.554510 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d65f2f-902d-44be-ac66-06ca43871326 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:53.554784 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d65f2f-902d-44be-ac66-06ca43871326 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:53.555559 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d65f2f-902d-44be-ac66-06ca43871326 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:53.555871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d65f2f-902d-44be-ac66-06ca43871326 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:53.557309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d65f2f-902d-44be-ac66-06ca43871326 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:53.570056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 628/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:09:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:53.576470 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225affba-43a3-46e6-a3d2-9b74544c8566 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:53.670440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225affba-43a3-46e6-a3d2-9b74544c8566 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:53.703627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa11b13-6fcb-465a-b951-ae0e565cf56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:53.704679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11b13-6fcb-465a-b951-ae0e565cf56e None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:53.704782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11b13-6fcb-465a-b951-ae0e565cf56e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:53.705060 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11b13-6fcb-465a-b951-ae0e565cf56e None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/3a7095f3ab8545c589d4d28a846ba1c0/roles/316db11de3994c7b86fcc1bba9da56bc` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:53.718782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa11b13-6fcb-465a-b951-ae0e565cf56e None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=3a7095f3ab8545c589d4d28a846ba1c0, role_id=316db11de3994c7b86fcc1bba9da56bc)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:53.720219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa11b13-6fcb-465a-b951-ae0e565cf56e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:53.847997 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 604/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:09:53 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/3a7095f3ab8545c589d4d28a846ba1c0/roles/316db11de3994c7b86fcc1bba9da56bc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:09:56.136353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c597a3-09de-4c00-aee3-c3be178f0fcc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:56.137492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c597a3-09de-4c00-aee3-c3be178f0fcc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:56.137492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c597a3-09de-4c00-aee3-c3be178f0fcc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:56.138785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 629/1233] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:09:56.144416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba38ec-533a-48a5-a6f3-6127a92d3ba4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:56.144906 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba38ec-533a-48a5-a6f3-6127a92d3ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:56.145056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba38ec-533a-48a5-a6f3-6127a92d3ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:56.162806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e2ba38ec-533a-48a5-a6f3-6127a92d3ba4 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:09:56.164057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e2ba38ec-533a-48a5-a6f3-6127a92d3ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:09:56.233274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 605/1234] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:09:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:09:56.258929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c597a3-09de-4c00-aee3-c3be178f0fcc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:56.356379 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c597a3-09de-4c00-aee3-c3be178f0fcc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:56.388653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342eb51-70ca-4aa1-a71e-42bf86083cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:56.389430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342eb51-70ca-4aa1-a71e-42bf86083cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:56.389680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342eb51-70ca-4aa1-a71e-42bf86083cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:56.389949 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342eb51-70ca-4aa1-a71e-42bf86083cf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:56.399550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342eb51-70ca-4aa1-a71e-42bf86083cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:09:56.406967 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-5342eb51-70ca-4aa1-a71e-42bf86083cf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 14:09:56.408169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 630/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Apr 12 14:09:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:56.414378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba38ec-533a-48a5-a6f3-6127a92d3ba4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:56.509878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba38ec-533a-48a5-a6f3-6127a92d3ba4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:56.543915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522828dc-a037-4d9d-b673-1ad24cb100e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:56.544751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522828dc-a037-4d9d-b673-1ad24cb100e4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:56.545061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522828dc-a037-4d9d-b673-1ad24cb100e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:56.545334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522828dc-a037-4d9d-b673-1ad24cb100e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:56.546077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522828dc-a037-4d9d-b673-1ad24cb100e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:56.546384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522828dc-a037-4d9d-b673-1ad24cb100e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:56.547751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522828dc-a037-4d9d-b673-1ad24cb100e4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:56.555543 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 606/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Apr 12 14:09:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:56.561422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342eb51-70ca-4aa1-a71e-42bf86083cf5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:56.658287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342eb51-70ca-4aa1-a71e-42bf86083cf5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:56.690973 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb675d-c113-4be3-a7ba-f44eaf7a5800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:56.691764 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb675d-c113-4be3-a7ba-f44eaf7a5800 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:56.692047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb675d-c113-4be3-a7ba-f44eaf7a5800 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:56.692321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb675d-c113-4be3-a7ba-f44eaf7a5800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:56.704313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb675d-c113-4be3-a7ba-f44eaf7a5800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:56.705809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb675d-c113-4be3-a7ba-f44eaf7a5800 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:56.722769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-8eeb675d-c113-4be3-a7ba-f44eaf7a5800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:09:56.723992 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 631/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:56.729824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522828dc-a037-4d9d-b673-1ad24cb100e4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:56.826643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522828dc-a037-4d9d-b673-1ad24cb100e4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:56.860140 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed656e-401a-49bc-ab26-556e6aee5e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:56.860803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed656e-401a-49bc-ab26-556e6aee5e8f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:56.861113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed656e-401a-49bc-ab26-556e6aee5e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:56.861391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed656e-401a-49bc-ab26-556e6aee5e8f None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:56.862112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed656e-401a-49bc-ab26-556e6aee5e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:56.862419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed656e-401a-49bc-ab26-556e6aee5e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:56.863786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed656e-401a-49bc-ab26-556e6aee5e8f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:56.876322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 607/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:56.881982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb675d-c113-4be3-a7ba-f44eaf7a5800 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:56.980665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb675d-c113-4be3-a7ba-f44eaf7a5800 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:57.014284 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67307b15-188b-4579-b146-2c205842a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:57.015085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67307b15-188b-4579-b146-2c205842a5aa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:57.015365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67307b15-188b-4579-b146-2c205842a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:57.015637 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67307b15-188b-4579-b146-2c205842a5aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:57.022993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67307b15-188b-4579-b146-2c205842a5aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:57.024417 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67307b15-188b-4579-b146-2c205842a5aa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:57.038105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-67307b15-188b-4579-b146-2c205842a5aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 14:09:57.039268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 632/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:09:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:57.045735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed656e-401a-49bc-ab26-556e6aee5e8f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:57.146828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed656e-401a-49bc-ab26-556e6aee5e8f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:57.180760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae6cfb-d950-460c-b88b-de40cf71fc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:57.181457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6cfb-d950-460c-b88b-de40cf71fc52 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:57.181739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6cfb-d950-460c-b88b-de40cf71fc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:57.182011 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6cfb-d950-460c-b88b-de40cf71fc52 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:57.182842 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae6cfb-d950-460c-b88b-de40cf71fc52 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:57.183147 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae6cfb-d950-460c-b88b-de40cf71fc52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:57.184572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae6cfb-d950-460c-b88b-de40cf71fc52 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:57.203345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 608/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Apr 12 14:09:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:57.209300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67307b15-188b-4579-b146-2c205842a5aa None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:57.305522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67307b15-188b-4579-b146-2c205842a5aa None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:57.338119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0546241-f468-4253-8033-a56d00d217f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:57.338754 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0546241-f468-4253-8033-a56d00d217f6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:57.339033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0546241-f468-4253-8033-a56d00d217f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:57.339304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0546241-f468-4253-8033-a56d00d217f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:57.403146 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0546241-f468-4253-8033-a56d00d217f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:57.404718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0546241-f468-4253-8033-a56d00d217f6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:57.499106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 633/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:09:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 14:09:57.504957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae6cfb-d950-460c-b88b-de40cf71fc52 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:57.604759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae6cfb-d950-460c-b88b-de40cf71fc52 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:57.636451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd88799-604d-450e-aa0f-9e10984f0da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:57.637262 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd88799-604d-450e-aa0f-9e10984f0da3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:57.637545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd88799-604d-450e-aa0f-9e10984f0da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:57.637818 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd88799-604d-450e-aa0f-9e10984f0da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:57.647979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd88799-604d-450e-aa0f-9e10984f0da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:57.649456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd88799-604d-450e-aa0f-9e10984f0da3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:57.666548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-2cd88799-604d-450e-aa0f-9e10984f0da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:09:57.667777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 609/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:57.673767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0546241-f468-4253-8033-a56d00d217f6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:57.770505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0546241-f468-4253-8033-a56d00d217f6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:57.884743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab01e0-5767-4e39-888e-8ea0d9d48175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:57.884743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab01e0-5767-4e39-888e-8ea0d9d48175 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:57.884743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab01e0-5767-4e39-888e-8ea0d9d48175 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:57.884743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab01e0-5767-4e39-888e-8ea0d9d48175 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:57.885309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab01e0-5767-4e39-888e-8ea0d9d48175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:57.885309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab01e0-5767-4e39-888e-8ea0d9d48175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:57.885309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab01e0-5767-4e39-888e-8ea0d9d48175 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:57.885309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 634/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:57.885679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd88799-604d-450e-aa0f-9e10984f0da3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:57.923932 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd88799-604d-450e-aa0f-9e10984f0da3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:57.957582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dfe0f-d310-48d2-83bf-f7a3f9f054dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:57.958362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dfe0f-d310-48d2-83bf-f7a3f9f054dd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:57.958643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dfe0f-d310-48d2-83bf-f7a3f9f054dd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:57.958916 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dfe0f-d310-48d2-83bf-f7a3f9f054dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:57.965459 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dfe0f-d310-48d2-83bf-f7a3f9f054dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:57.966960 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dfe0f-d310-48d2-83bf-f7a3f9f054dd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:57.979733 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-456dfe0f-d310-48d2-83bf-f7a3f9f054dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:09:57.980913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 610/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:09:57.986841 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab01e0-5767-4e39-888e-8ea0d9d48175 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:58.084262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab01e0-5767-4e39-888e-8ea0d9d48175 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:58.115890 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4740c24-22c0-44eb-ab48-580c63015351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:58.120844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740c24-22c0-44eb-ab48-580c63015351 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:58.120844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740c24-22c0-44eb-ab48-580c63015351 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:58.120844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740c24-22c0-44eb-ab48-580c63015351 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:58.120844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4740c24-22c0-44eb-ab48-580c63015351 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:58.120844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4740c24-22c0-44eb-ab48-580c63015351 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:58.120844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4740c24-22c0-44eb-ab48-580c63015351 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:58.132181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 635/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:09:58.138363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dfe0f-d310-48d2-83bf-f7a3f9f054dd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:09:58.235344 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dfe0f-d310-48d2-83bf-f7a3f9f054dd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:09:58.267829 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1285af5-8d88-4c1c-85d6-d2ccda4d6b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:09:58.268470 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1285af5-8d88-4c1c-85d6-d2ccda4d6b58 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:09:58.268749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1285af5-8d88-4c1c-85d6-d2ccda4d6b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:09:58.269050 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1285af5-8d88-4c1c-85d6-d2ccda4d6b58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:09:58.269866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1285af5-8d88-4c1c-85d6-d2ccda4d6b58 None admin] RBAC: Adding query filter params (role.id=316db11de3994c7b86fcc1bba9da56bc, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=3a7095f3ab8545c589d4d28a846ba1c0) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:09:58.270170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1285af5-8d88-4c1c-85d6-d2ccda4d6b58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:09:58.271580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1285af5-8d88-4c1c-85d6-d2ccda4d6b58 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:09:58.277342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 611/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:09:58 2022] GET /identity/v3/role_assignments?user.id=3a7095f3ab8545c589d4d28a846ba1c0&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=316db11de3994c7b86fcc1bba9da56bc => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:00.771228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4078f-d1d1-4baf-af51-caa638bcb5d7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:00.771778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4078f-d1d1-4baf-af51-caa638bcb5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:00.771778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4078f-d1d1-4baf-af51-caa638bcb5d7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:00.773178 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 636/1247] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:10:00.778780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9603aab-0239-4dd8-9518-c27bc1f1f60f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:00.779782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9603aab-0239-4dd8-9518-c27bc1f1f60f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:00.779886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9603aab-0239-4dd8-9518-c27bc1f1f60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:00.797368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a9603aab-0239-4dd8-9518-c27bc1f1f60f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:10:00.801822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a9603aab-0239-4dd8-9518-c27bc1f1f60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:10:00.867673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 612/1248] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:10:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:10:00.895150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4078f-d1d1-4baf-af51-caa638bcb5d7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:00.997646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4078f-d1d1-4baf-af51-caa638bcb5d7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:01.031491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0ab05-a3ba-4116-a1ad-46bd0f44fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:01.032282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0ab05-a3ba-4116-a1ad-46bd0f44fdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:01.032564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0ab05-a3ba-4116-a1ad-46bd0f44fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:01.032837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0ab05-a3ba-4116-a1ad-46bd0f44fdd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:01.042790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0ab05-a3ba-4116-a1ad-46bd0f44fdd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:10:01.049850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-6bc0ab05-a3ba-4116-a1ad-46bd0f44fdd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:10:01.051091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 637/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:01.057360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9603aab-0239-4dd8-9518-c27bc1f1f60f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:01.153436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9603aab-0239-4dd8-9518-c27bc1f1f60f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:01.187443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5085ea-47b4-4d28-8ed6-88bb6048334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:01.188110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5085ea-47b4-4d28-8ed6-88bb6048334a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:01.188393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5085ea-47b4-4d28-8ed6-88bb6048334a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:01.188665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5085ea-47b4-4d28-8ed6-88bb6048334a None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:01.189434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5085ea-47b4-4d28-8ed6-88bb6048334a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:01.189741 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5085ea-47b4-4d28-8ed6-88bb6048334a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:01.191113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5085ea-47b4-4d28-8ed6-88bb6048334a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:01.199414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 613/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:01.205800 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0ab05-a3ba-4116-a1ad-46bd0f44fdd6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:01.307338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0ab05-a3ba-4116-a1ad-46bd0f44fdd6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:01.341395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5cd21-6031-4aa8-ba6f-31ae9c5ebea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:01.342481 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cd21-6031-4aa8-ba6f-31ae9c5ebea1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:01.342763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cd21-6031-4aa8-ba6f-31ae9c5ebea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:01.343080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cd21-6031-4aa8-ba6f-31ae9c5ebea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:01.353534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5cd21-6031-4aa8-ba6f-31ae9c5ebea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:01.355083 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5cd21-6031-4aa8-ba6f-31ae9c5ebea1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:01.371716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-33e5cd21-6031-4aa8-ba6f-31ae9c5ebea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:10:01.372941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 638/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:01.379349 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5085ea-47b4-4d28-8ed6-88bb6048334a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:01.477547 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5085ea-47b4-4d28-8ed6-88bb6048334a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:01.512033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18707934-dc81-42c2-86f5-d3331496a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:01.512714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18707934-dc81-42c2-86f5-d3331496a62e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:01.512997 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18707934-dc81-42c2-86f5-d3331496a62e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:01.513280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18707934-dc81-42c2-86f5-d3331496a62e None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:01.514023 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18707934-dc81-42c2-86f5-d3331496a62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:01.514479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18707934-dc81-42c2-86f5-d3331496a62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:01.515855 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18707934-dc81-42c2-86f5-d3331496a62e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:01.527241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 614/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:01.533527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5cd21-6031-4aa8-ba6f-31ae9c5ebea1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:01.631529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5cd21-6031-4aa8-ba6f-31ae9c5ebea1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:01.665220 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90378e8-046f-4902-849a-e60221fa040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:01.665511 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90378e8-046f-4902-849a-e60221fa040e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:01.665792 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90378e8-046f-4902-849a-e60221fa040e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:01.666108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90378e8-046f-4902-849a-e60221fa040e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:01.675021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90378e8-046f-4902-849a-e60221fa040e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:01.676439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90378e8-046f-4902-849a-e60221fa040e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:01.696056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-c90378e8-046f-4902-849a-e60221fa040e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 14:10:01.697889 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 639/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:10:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:01.703822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18707934-dc81-42c2-86f5-d3331496a62e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:01.800105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18707934-dc81-42c2-86f5-d3331496a62e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:01.832525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafe9b3-1b08-4a05-b72f-7f113fd436d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:01.833209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafe9b3-1b08-4a05-b72f-7f113fd436d1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:01.833487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafe9b3-1b08-4a05-b72f-7f113fd436d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:01.833756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafe9b3-1b08-4a05-b72f-7f113fd436d1 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:01.834580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafe9b3-1b08-4a05-b72f-7f113fd436d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:01.834918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafe9b3-1b08-4a05-b72f-7f113fd436d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:01.836337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafe9b3-1b08-4a05-b72f-7f113fd436d1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:01.853309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 615/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Apr 12 14:10:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:01.859955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90378e8-046f-4902-849a-e60221fa040e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:01.956721 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90378e8-046f-4902-849a-e60221fa040e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:01.988668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4beef3-f083-423d-add4-a4c171cb92a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:01.989350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4beef3-f083-423d-add4-a4c171cb92a9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:01.989667 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4beef3-f083-423d-add4-a4c171cb92a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:01.989941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4beef3-f083-423d-add4-a4c171cb92a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:02.054147 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4beef3-f083-423d-add4-a4c171cb92a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:02.055644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4beef3-f083-423d-add4-a4c171cb92a9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:02.155606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 640/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:10:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:10:02.161659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafe9b3-1b08-4a05-b72f-7f113fd436d1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:02.265215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafe9b3-1b08-4a05-b72f-7f113fd436d1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:02.298907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4295df-d8d7-4d39-b7e2-420a4855852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:02.299689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4295df-d8d7-4d39-b7e2-420a4855852f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:02.299975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4295df-d8d7-4d39-b7e2-420a4855852f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:02.300239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4295df-d8d7-4d39-b7e2-420a4855852f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:02.310190 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4295df-d8d7-4d39-b7e2-420a4855852f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:02.312184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4295df-d8d7-4d39-b7e2-420a4855852f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:02.330302 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-1b4295df-d8d7-4d39-b7e2-420a4855852f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:10:02.331486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 616/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:02.337526 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4beef3-f083-423d-add4-a4c171cb92a9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:02.432790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4beef3-f083-423d-add4-a4c171cb92a9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:02.464733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef5f71-1a65-4ec2-b5ce-ea0e99032597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:02.465412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef5f71-1a65-4ec2-b5ce-ea0e99032597 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:02.465694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef5f71-1a65-4ec2-b5ce-ea0e99032597 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:02.465963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef5f71-1a65-4ec2-b5ce-ea0e99032597 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:02.467184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef5f71-1a65-4ec2-b5ce-ea0e99032597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:02.467528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef5f71-1a65-4ec2-b5ce-ea0e99032597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:02.468926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef5f71-1a65-4ec2-b5ce-ea0e99032597 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:02.480944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 641/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:02.486235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4295df-d8d7-4d39-b7e2-420a4855852f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:02.581706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4295df-d8d7-4d39-b7e2-420a4855852f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:02.614631 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcddef6-5611-474d-9d33-3eae124b923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:02.615418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcddef6-5611-474d-9d33-3eae124b923f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:02.615695 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcddef6-5611-474d-9d33-3eae124b923f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:02.616054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcddef6-5611-474d-9d33-3eae124b923f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:02.622469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcddef6-5611-474d-9d33-3eae124b923f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:02.623956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcddef6-5611-474d-9d33-3eae124b923f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:02.636654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-cbcddef6-5611-474d-9d33-3eae124b923f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:10:02.643109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 617/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:10:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:02.644370 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef5f71-1a65-4ec2-b5ce-ea0e99032597 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:02.740679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef5f71-1a65-4ec2-b5ce-ea0e99032597 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:02.775287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefe174-39fb-42ea-a1c2-86d6b52d4c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:02.775952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefe174-39fb-42ea-a1c2-86d6b52d4c38 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:02.776233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefe174-39fb-42ea-a1c2-86d6b52d4c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:02.776534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefe174-39fb-42ea-a1c2-86d6b52d4c38 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:02.777602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefe174-39fb-42ea-a1c2-86d6b52d4c38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:02.777938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefe174-39fb-42ea-a1c2-86d6b52d4c38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:02.779403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefe174-39fb-42ea-a1c2-86d6b52d4c38 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:02.792324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 642/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:10:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:02.798430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcddef6-5611-474d-9d33-3eae124b923f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:02.901233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcddef6-5611-474d-9d33-3eae124b923f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:02.936263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04489085-a034-444a-8862-52b4b88597dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:02.936927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04489085-a034-444a-8862-52b4b88597dd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:02.937246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04489085-a034-444a-8862-52b4b88597dd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:02.937521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04489085-a034-444a-8862-52b4b88597dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:02.938349 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04489085-a034-444a-8862-52b4b88597dd None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=3a7095f3ab8545c589d4d28a846ba1c0) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:02.938662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04489085-a034-444a-8862-52b4b88597dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:02.940081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04489085-a034-444a-8862-52b4b88597dd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:02.945784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 618/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:10:02 2022] GET /identity/v3/role_assignments?user.id=3a7095f3ab8545c589d4d28a846ba1c0&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:05.219516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f76b4-5ed7-4d55-923b-efd98438f96f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:05.220052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f76b4-5ed7-4d55-923b-efd98438f96f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:05.220052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f76b4-5ed7-4d55-923b-efd98438f96f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:05.221450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 643/1261] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:10:05.226791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3e31-0115-497c-bc7f-4c3ce3423eba None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:05.227199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3e31-0115-497c-bc7f-4c3ce3423eba None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:05.227334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3e31-0115-497c-bc7f-4c3ce3423eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:05.243741 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-faae3e31-0115-497c-bc7f-4c3ce3423eba None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:10:05.244916 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-faae3e31-0115-497c-bc7f-4c3ce3423eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:10:05.312025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 619/1262] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:10:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:10:05.335573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f76b4-5ed7-4d55-923b-efd98438f96f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:05.436880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f76b4-5ed7-4d55-923b-efd98438f96f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:05.471310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619b2c8-c2c3-4d9d-8dae-8fd04a341510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:05.472058 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619b2c8-c2c3-4d9d-8dae-8fd04a341510 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:05.472372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619b2c8-c2c3-4d9d-8dae-8fd04a341510 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:05.472648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619b2c8-c2c3-4d9d-8dae-8fd04a341510 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:05.482856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619b2c8-c2c3-4d9d-8dae-8fd04a341510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:10:05.489843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-7619b2c8-c2c3-4d9d-8dae-8fd04a341510 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:10:05.491046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 644/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:10:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:05.499811 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae3e31-0115-497c-bc7f-4c3ce3423eba None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:05.596581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae3e31-0115-497c-bc7f-4c3ce3423eba None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:05.630081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fba807-a510-4a24-8e09-e2dbb72dc27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:05.630786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fba807-a510-4a24-8e09-e2dbb72dc27f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:05.631070 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fba807-a510-4a24-8e09-e2dbb72dc27f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:05.631345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fba807-a510-4a24-8e09-e2dbb72dc27f None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:05.632107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fba807-a510-4a24-8e09-e2dbb72dc27f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:05.632412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fba807-a510-4a24-8e09-e2dbb72dc27f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:05.633813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fba807-a510-4a24-8e09-e2dbb72dc27f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:05.642693 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 620/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:05.648564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619b2c8-c2c3-4d9d-8dae-8fd04a341510 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:05.749636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619b2c8-c2c3-4d9d-8dae-8fd04a341510 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:05.780845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437a25d-bdb2-4f59-a7eb-cdb671fa4782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:05.781655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437a25d-bdb2-4f59-a7eb-cdb671fa4782 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:05.781941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437a25d-bdb2-4f59-a7eb-cdb671fa4782 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:05.782216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437a25d-bdb2-4f59-a7eb-cdb671fa4782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:05.794656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437a25d-bdb2-4f59-a7eb-cdb671fa4782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:05.796761 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437a25d-bdb2-4f59-a7eb-cdb671fa4782 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:05.813342 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-8437a25d-bdb2-4f59-a7eb-cdb671fa4782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:10:05.814558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 645/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:05.820993 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fba807-a510-4a24-8e09-e2dbb72dc27f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:05.922758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fba807-a510-4a24-8e09-e2dbb72dc27f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:05.955724 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ddc24-12ce-4fb4-870b-ca1c3b8db31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:05.956376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ddc24-12ce-4fb4-870b-ca1c3b8db31d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:05.956654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ddc24-12ce-4fb4-870b-ca1c3b8db31d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:05.956925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ddc24-12ce-4fb4-870b-ca1c3b8db31d None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:05.957666 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ddc24-12ce-4fb4-870b-ca1c3b8db31d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:05.957963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ddc24-12ce-4fb4-870b-ca1c3b8db31d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:05.959324 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ddc24-12ce-4fb4-870b-ca1c3b8db31d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:05.970742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 621/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:05.976629 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437a25d-bdb2-4f59-a7eb-cdb671fa4782 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:06.072480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437a25d-bdb2-4f59-a7eb-cdb671fa4782 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:06.105807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0572edc-03c8-4504-b4a7-9d274ab545c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:06.106612 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0572edc-03c8-4504-b4a7-9d274ab545c0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:06.106893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0572edc-03c8-4504-b4a7-9d274ab545c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:06.107164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0572edc-03c8-4504-b4a7-9d274ab545c0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:06.115321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0572edc-03c8-4504-b4a7-9d274ab545c0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:06.116750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0572edc-03c8-4504-b4a7-9d274ab545c0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:06.130938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-a0572edc-03c8-4504-b4a7-9d274ab545c0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 14:10:06.132136 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 646/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:10:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:06.137953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ddc24-12ce-4fb4-870b-ca1c3b8db31d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:06.233578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ddc24-12ce-4fb4-870b-ca1c3b8db31d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:06.266727 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55a3b0-48c7-4b32-96e4-a90f7b1dfd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:06.267389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55a3b0-48c7-4b32-96e4-a90f7b1dfd7d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:06.267671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55a3b0-48c7-4b32-96e4-a90f7b1dfd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:06.267947 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55a3b0-48c7-4b32-96e4-a90f7b1dfd7d None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:06.268773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55a3b0-48c7-4b32-96e4-a90f7b1dfd7d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:06.269117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55a3b0-48c7-4b32-96e4-a90f7b1dfd7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:06.270533 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55a3b0-48c7-4b32-96e4-a90f7b1dfd7d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:06.287651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 622/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Apr 12 14:10:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:06.293355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0572edc-03c8-4504-b4a7-9d274ab545c0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:06.392071 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0572edc-03c8-4504-b4a7-9d274ab545c0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:06.424324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd885ed1-a9fb-47c6-bfb3-659a1e3b6f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:06.425195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd885ed1-a9fb-47c6-bfb3-659a1e3b6f9a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:06.425475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd885ed1-a9fb-47c6-bfb3-659a1e3b6f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:06.425746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd885ed1-a9fb-47c6-bfb3-659a1e3b6f9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:06.436391 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd885ed1-a9fb-47c6-bfb3-659a1e3b6f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:06.437857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd885ed1-a9fb-47c6-bfb3-659a1e3b6f9a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:06.454591 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-bd885ed1-a9fb-47c6-bfb3-659a1e3b6f9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:10:06.455772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 647/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:06.461645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55a3b0-48c7-4b32-96e4-a90f7b1dfd7d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:06.555855 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55a3b0-48c7-4b32-96e4-a90f7b1dfd7d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:06.589485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd90ef2-f871-46bc-9e11-378986927911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:06.590144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd90ef2-f871-46bc-9e11-378986927911 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:06.590424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd90ef2-f871-46bc-9e11-378986927911 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:06.590695 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd90ef2-f871-46bc-9e11-378986927911 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:06.591404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd90ef2-f871-46bc-9e11-378986927911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:06.591734 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd90ef2-f871-46bc-9e11-378986927911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:06.593532 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd90ef2-f871-46bc-9e11-378986927911 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:06.604340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 623/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:06.610783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd885ed1-a9fb-47c6-bfb3-659a1e3b6f9a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:06.710480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd885ed1-a9fb-47c6-bfb3-659a1e3b6f9a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:06.744637 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4713-5964-4f52-a0fc-1939d3aa0505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:06.745456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4713-5964-4f52-a0fc-1939d3aa0505 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:06.745735 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4713-5964-4f52-a0fc-1939d3aa0505 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:06.746005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4713-5964-4f52-a0fc-1939d3aa0505 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:06.753144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b4713-5964-4f52-a0fc-1939d3aa0505 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:06.754583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b4713-5964-4f52-a0fc-1939d3aa0505 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:06.768532 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-619b4713-5964-4f52-a0fc-1939d3aa0505 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:10:06.769712 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 648/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:10:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:06.775674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd90ef2-f871-46bc-9e11-378986927911 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:06.871970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd90ef2-f871-46bc-9e11-378986927911 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:06.906582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b0500-bcc4-485c-a47b-c2e63f227d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:06.907338 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b0500-bcc4-485c-a47b-c2e63f227d56 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:06.907665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b0500-bcc4-485c-a47b-c2e63f227d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:06.908046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b0500-bcc4-485c-a47b-c2e63f227d56 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:06.908790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b0500-bcc4-485c-a47b-c2e63f227d56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:06.909165 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b0500-bcc4-485c-a47b-c2e63f227d56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:06.910681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b0500-bcc4-485c-a47b-c2e63f227d56 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:06.923229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 624/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:10:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:10:06.929099 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4713-5964-4f52-a0fc-1939d3aa0505 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:07.032554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4713-5964-4f52-a0fc-1939d3aa0505 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:07.066337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cf5dc-6748-4555-9724-a4f6a175bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:07.067226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cf5dc-6748-4555-9724-a4f6a175bada None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:07.067508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cf5dc-6748-4555-9724-a4f6a175bada None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:07.067787 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cf5dc-6748-4555-9724-a4f6a175bada None admin] PATH_INFO: `/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/3a7095f3ab8545c589d4d28a846ba1c0/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:07.070033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cf5dc-6748-4555-9724-a4f6a175bada None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cdd6573ea4a0a86a689e9a7d254c4, user_id=3a7095f3ab8545c589d4d28a846ba1c0, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:07.071463 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cf5dc-6748-4555-9724-a4f6a175bada None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:07.197491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 649/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Apr 12 14:10:06 2022] PUT /identity/v3/projects/3e8cdd6573ea4a0a86a689e9a7d254c4/users/3a7095f3ab8545c589d4d28a846ba1c0/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:10:09.514960 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5aeb6-d7f5-4c05-9afc-cee330c18c33 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:09.515495 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5aeb6-d7f5-4c05-9afc-cee330c18c33 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:09.515495 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5aeb6-d7f5-4c05-9afc-cee330c18c33 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:09.516868 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 625/1274] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:10:09.522240 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec37a8f-b31c-47db-a274-68cbe0283558 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:09.522670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec37a8f-b31c-47db-a274-68cbe0283558 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:09.522788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec37a8f-b31c-47db-a274-68cbe0283558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:09.540523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8ec37a8f-b31c-47db-a274-68cbe0283558 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:10:09.541730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8ec37a8f-b31c-47db-a274-68cbe0283558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:10:09.605812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 650/1275] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:10:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:10:09.634040 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5aeb6-d7f5-4c05-9afc-cee330c18c33 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:09.731031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5aeb6-d7f5-4c05-9afc-cee330c18c33 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:09.762399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c94c6-db46-4a5d-a23c-dfca79eca704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:09.763173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c94c6-db46-4a5d-a23c-dfca79eca704 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:09.763455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c94c6-db46-4a5d-a23c-dfca79eca704 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:09.764216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c94c6-db46-4a5d-a23c-dfca79eca704 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:09.773809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c94c6-db46-4a5d-a23c-dfca79eca704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 14:10:09.781232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-367c94c6-db46-4a5d-a23c-dfca79eca704 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 14:10:09.782431 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 626/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Apr 12 14:10:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:09.788358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec37a8f-b31c-47db-a274-68cbe0283558 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:09.883061 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec37a8f-b31c-47db-a274-68cbe0283558 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:09.915184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5bbde-22c8-4d81-b856-de539df212fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:09.915840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5bbde-22c8-4d81-b856-de539df212fb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:09.916117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5bbde-22c8-4d81-b856-de539df212fb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:09.916733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5bbde-22c8-4d81-b856-de539df212fb None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:09.917181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5bbde-22c8-4d81-b856-de539df212fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:09.917489 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5bbde-22c8-4d81-b856-de539df212fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:09.918836 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5bbde-22c8-4d81-b856-de539df212fb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:09.926480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 651/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Apr 12 14:10:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:09.932150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c94c6-db46-4a5d-a23c-dfca79eca704 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:10.030288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c94c6-db46-4a5d-a23c-dfca79eca704 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:10.062537 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb9fd9-69cc-4df2-bca9-f43f441f2d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:10.063323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb9fd9-69cc-4df2-bca9-f43f441f2d3a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:10.063606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb9fd9-69cc-4df2-bca9-f43f441f2d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:10.063878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb9fd9-69cc-4df2-bca9-f43f441f2d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:10.074290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb9fd9-69cc-4df2-bca9-f43f441f2d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:10.075723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb9fd9-69cc-4df2-bca9-f43f441f2d3a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:10.092390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-5bdb9fd9-69cc-4df2-bca9-f43f441f2d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:10:10.093620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 627/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 14:10:10.099504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5bbde-22c8-4d81-b856-de539df212fb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:10.196846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5bbde-22c8-4d81-b856-de539df212fb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:10.230300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e653f6-31c4-4d1c-bd93-5e78de539cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:10.231030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e653f6-31c4-4d1c-bd93-5e78de539cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:10.231310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e653f6-31c4-4d1c-bd93-5e78de539cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:10.231584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e653f6-31c4-4d1c-bd93-5e78de539cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:10.232304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e653f6-31c4-4d1c-bd93-5e78de539cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:10.233152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e653f6-31c4-4d1c-bd93-5e78de539cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:10.234568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e653f6-31c4-4d1c-bd93-5e78de539cf4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:10.246646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 652/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:10.253237 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb9fd9-69cc-4df2-bca9-f43f441f2d3a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:10.350175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb9fd9-69cc-4df2-bca9-f43f441f2d3a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:10.383136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507aed1-617b-496b-a67c-082c7dabc0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:10.383978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507aed1-617b-496b-a67c-082c7dabc0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:10.384263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507aed1-617b-496b-a67c-082c7dabc0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:10.384537 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507aed1-617b-496b-a67c-082c7dabc0e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:10.391665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507aed1-617b-496b-a67c-082c7dabc0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:10.393129 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507aed1-617b-496b-a67c-082c7dabc0e8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:10.406234 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-a507aed1-617b-496b-a67c-082c7dabc0e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 14:10:10.407381 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 628/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:10:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:10.413561 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e653f6-31c4-4d1c-bd93-5e78de539cf4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:10.512548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e653f6-31c4-4d1c-bd93-5e78de539cf4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:10.547940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df5efb-605e-4d9f-b573-114354f92938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:10.548609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df5efb-605e-4d9f-b573-114354f92938 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:10.548891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df5efb-605e-4d9f-b573-114354f92938 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:10.549189 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df5efb-605e-4d9f-b573-114354f92938 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:10.550110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df5efb-605e-4d9f-b573-114354f92938 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:10.550422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df5efb-605e-4d9f-b573-114354f92938 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:10.551844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df5efb-605e-4d9f-b573-114354f92938 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:10.568495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 653/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Apr 12 14:10:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:10.574605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507aed1-617b-496b-a67c-082c7dabc0e8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:10.670650 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507aed1-617b-496b-a67c-082c7dabc0e8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:10.703444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0d16d-e875-4c84-b976-786174f4ff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:10.704096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0d16d-e875-4c84-b976-786174f4ff77 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:10.704379 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0d16d-e875-4c84-b976-786174f4ff77 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:10.704653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0d16d-e875-4c84-b976-786174f4ff77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:10.775304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0d16d-e875-4c84-b976-786174f4ff77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:10.776765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0d16d-e875-4c84-b976-786174f4ff77 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:10.875198 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 629/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Apr 12 14:10:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 14:10:10.881373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df5efb-605e-4d9f-b573-114354f92938 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:10.978744 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df5efb-605e-4d9f-b573-114354f92938 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:11.012979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0c5c7-32eb-49e5-9419-c1ed1ed8051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:11.014328 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c5c7-32eb-49e5-9419-c1ed1ed8051a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:11.014617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c5c7-32eb-49e5-9419-c1ed1ed8051a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:11.014893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c5c7-32eb-49e5-9419-c1ed1ed8051a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:11.024823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0c5c7-32eb-49e5-9419-c1ed1ed8051a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:11.026298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0c5c7-32eb-49e5-9419-c1ed1ed8051a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:11.044254 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-f0e0c5c7-32eb-49e5-9419-c1ed1ed8051a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 14:10:11.045515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 654/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:11.051486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0d16d-e875-4c84-b976-786174f4ff77 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:11.153885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0d16d-e875-4c84-b976-786174f4ff77 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:11.189368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c849fd-3b32-4d0a-8c5d-d1efe4436f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:11.190028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c849fd-3b32-4d0a-8c5d-d1efe4436f29 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:11.190342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c849fd-3b32-4d0a-8c5d-d1efe4436f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:11.190594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c849fd-3b32-4d0a-8c5d-d1efe4436f29 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:11.191316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c849fd-3b32-4d0a-8c5d-d1efe4436f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:11.191623 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c849fd-3b32-4d0a-8c5d-d1efe4436f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:11.193073 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c849fd-3b32-4d0a-8c5d-d1efe4436f29 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:11.204589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 630/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Apr 12 14:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:10:11.211331 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0c5c7-32eb-49e5-9419-c1ed1ed8051a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:11.320572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0c5c7-32eb-49e5-9419-c1ed1ed8051a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:11.356265 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fbb3b-0b0e-48e6-8c0b-3c772018f7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:11.357116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fbb3b-0b0e-48e6-8c0b-3c772018f7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:11.357992 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fbb3b-0b0e-48e6-8c0b-3c772018f7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:11.358453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fbb3b-0b0e-48e6-8c0b-3c772018f7f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:11.366340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fbb3b-0b0e-48e6-8c0b-3c772018f7f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:11.367809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fbb3b-0b0e-48e6-8c0b-3c772018f7f7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:11.382185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.application [None req-740fbb3b-0b0e-48e6-8c0b-3c772018f7f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 14:10:11.383399 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 655/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Apr 12 14:10:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:11.389775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c849fd-3b32-4d0a-8c5d-d1efe4436f29 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:11.495316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c849fd-3b32-4d0a-8c5d-d1efe4436f29 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:11.531003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a044bb5-c963-4466-9873-44aac1430361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:11.531679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044bb5-c963-4466-9873-44aac1430361 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:11.531973 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044bb5-c963-4466-9873-44aac1430361 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:11.532249 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044bb5-c963-4466-9873-44aac1430361 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:11.533084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a044bb5-c963-4466-9873-44aac1430361 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:11.533398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a044bb5-c963-4466-9873-44aac1430361 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:11.534873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a044bb5-c963-4466-9873-44aac1430361 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:11.548254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 631/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Apr 12 14:10:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:11.554980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fbb3b-0b0e-48e6-8c0b-3c772018f7f7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:11.658738 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fbb3b-0b0e-48e6-8c0b-3c772018f7f7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:11.696863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b115d-ac1c-40e9-8227-e16159520ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:11.697612 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b115d-ac1c-40e9-8227-e16159520ade None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:11.697902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b115d-ac1c-40e9-8227-e16159520ade None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:11.698179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b115d-ac1c-40e9-8227-e16159520ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:11.699015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b115d-ac1c-40e9-8227-e16159520ade None admin] RBAC: Adding query filter params (role.id=fcc1fe96070d4683b1979cb74c1e7184, scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4, user.id=3a7095f3ab8545c589d4d28a846ba1c0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:11.699326 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b115d-ac1c-40e9-8227-e16159520ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:11.700745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b115d-ac1c-40e9-8227-e16159520ade None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:11.707239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 656/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Apr 12 14:10:11 2022] GET /identity/v3/role_assignments?user.id=3a7095f3ab8545c589d4d28a846ba1c0&scope.project.id=3e8cdd6573ea4a0a86a689e9a7d254c4&role.id=fcc1fe96070d4683b1979cb74c1e7184 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:14.044761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850166c7-c23e-4c9c-b010-dda831d587d9 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:14.045933 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850166c7-c23e-4c9c-b010-dda831d587d9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:14.045933 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850166c7-c23e-4c9c-b010-dda831d587d9 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:14.047212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 632/1288] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:10:14.052536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7fdb7-f6d3-4f42-94d2-c5802712a66a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:14.056134 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7fdb7-f6d3-4f42-94d2-c5802712a66a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:14.056134 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7fdb7-f6d3-4f42-94d2-c5802712a66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:14.070048 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e2c7fdb7-f6d3-4f42-94d2-c5802712a66a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:10:14.071206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e2c7fdb7-f6d3-4f42-94d2-c5802712a66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:10:14.134007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 657/1289] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:10:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:10:14.156089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850166c7-c23e-4c9c-b010-dda831d587d9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:14.255708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850166c7-c23e-4c9c-b010-dda831d587d9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:14.289117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00e81c-d7d3-4c1e-a642-0168c9fc4554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:14.289887 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00e81c-d7d3-4c1e-a642-0168c9fc4554 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:14.290172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00e81c-d7d3-4c1e-a642-0168c9fc4554 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:14.290443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00e81c-d7d3-4c1e-a642-0168c9fc4554 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:14.291085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00e81c-d7d3-4c1e-a642-0168c9fc4554 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:14.292440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00e81c-d7d3-4c1e-a642-0168c9fc4554 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:14.304198 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-fb00e81c-d7d3-4c1e-a642-0168c9fc4554 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 14:10:14.305184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 633/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Apr 12 14:10:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:14.312903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7fdb7-f6d3-4f42-94d2-c5802712a66a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:14.407018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7fdb7-f6d3-4f42-94d2-c5802712a66a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:14.439306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02013d-41f8-439b-aa2d-5ffbe00959e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:14.439957 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02013d-41f8-439b-aa2d-5ffbe00959e4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:14.440234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02013d-41f8-439b-aa2d-5ffbe00959e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:14.440504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02013d-41f8-439b-aa2d-5ffbe00959e4 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:14.441260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02013d-41f8-439b-aa2d-5ffbe00959e4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:14.441570 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02013d-41f8-439b-aa2d-5ffbe00959e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:14.442906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02013d-41f8-439b-aa2d-5ffbe00959e4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:14.447846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 658/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Tue Apr 12 14:10:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:14.454037 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00e81c-d7d3-4c1e-a642-0168c9fc4554 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:14.553895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00e81c-d7d3-4c1e-a642-0168c9fc4554 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:14.585822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e1c64-7e75-4ab4-b50c-9ffca3a39425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:14.586396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1c64-7e75-4ab4-b50c-9ffca3a39425 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:14.586673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1c64-7e75-4ab4-b50c-9ffca3a39425 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:14.586945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1c64-7e75-4ab4-b50c-9ffca3a39425 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:14.587634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e1c64-7e75-4ab4-b50c-9ffca3a39425 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:14.587941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e1c64-7e75-4ab4-b50c-9ffca3a39425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:14.589330 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e1c64-7e75-4ab4-b50c-9ffca3a39425 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:14.594446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 634/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Tue Apr 12 14:10:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:16.899878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b4a6f-5093-4ec7-8ec8-096a2887021f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:16.900454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b4a6f-5093-4ec7-8ec8-096a2887021f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:16.900454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b4a6f-5093-4ec7-8ec8-096a2887021f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:16.901855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 659/1293] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:10:16.907333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed329217-8baf-46ea-874a-17e95f540020 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:16.909461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed329217-8baf-46ea-874a-17e95f540020 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:16.909461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed329217-8baf-46ea-874a-17e95f540020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:16.924902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ed329217-8baf-46ea-874a-17e95f540020 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:10:16.926035 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ed329217-8baf-46ea-874a-17e95f540020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:10:16.989774 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 635/1294] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:10:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:10:17.014197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b4a6f-5093-4ec7-8ec8-096a2887021f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:17.109972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b4a6f-5093-4ec7-8ec8-096a2887021f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:17.142551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9de13-3110-4e5a-bd80-589e76f7fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:17.143235 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9de13-3110-4e5a-bd80-589e76f7fe02 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:17.143490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9de13-3110-4e5a-bd80-589e76f7fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:17.143764 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9de13-3110-4e5a-bd80-589e76f7fe02 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:17.144608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9de13-3110-4e5a-bd80-589e76f7fe02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:17.145844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9de13-3110-4e5a-bd80-589e76f7fe02 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:17.220266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 660/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Apr 12 14:10:17 2022] POST /identity/v3/services => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:10:19.548682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee591585-cf93-40fb-9ca0-3427eace9dab None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:19.549268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee591585-cf93-40fb-9ca0-3427eace9dab None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:19.549268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee591585-cf93-40fb-9ca0-3427eace9dab None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:19.550625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 636/1296] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:10:19.556009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdbf55-0ff4-40de-8e7d-221b2b6e1619 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:19.556677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdbf55-0ff4-40de-8e7d-221b2b6e1619 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:19.556677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdbf55-0ff4-40de-8e7d-221b2b6e1619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:19.573542 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-07bdbf55-0ff4-40de-8e7d-221b2b6e1619 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:10:19.574721 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-07bdbf55-0ff4-40de-8e7d-221b2b6e1619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:10:19.645141 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 661/1297] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:10:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:10:19.669893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee591585-cf93-40fb-9ca0-3427eace9dab None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:19.769989 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee591585-cf93-40fb-9ca0-3427eace9dab None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:19.803669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf9990-4ee2-4622-8456-42cec7882ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:19.804385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf9990-4ee2-4622-8456-42cec7882ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:19.804667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf9990-4ee2-4622-8456-42cec7882ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:19.805069 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf9990-4ee2-4622-8456-42cec7882ef6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:19.805769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf9990-4ee2-4622-8456-42cec7882ef6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:19.807122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf9990-4ee2-4622-8456-42cec7882ef6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:19.818247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-b0bf9990-4ee2-4622-8456-42cec7882ef6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 14:10:19.819394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 637/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Apr 12 14:10:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:19.826020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdbf55-0ff4-40de-8e7d-221b2b6e1619 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:19.922355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdbf55-0ff4-40de-8e7d-221b2b6e1619 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:19.954596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5aee5-ec8b-48fa-9e6b-b719593ee77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:19.955255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5aee5-ec8b-48fa-9e6b-b719593ee77d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:19.955536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5aee5-ec8b-48fa-9e6b-b719593ee77d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:19.955806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5aee5-ec8b-48fa-9e6b-b719593ee77d None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:19.956507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5aee5-ec8b-48fa-9e6b-b719593ee77d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:19.956809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5aee5-ec8b-48fa-9e6b-b719593ee77d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:19.958196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5aee5-ec8b-48fa-9e6b-b719593ee77d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:19.963227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 662/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Tue Apr 12 14:10:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:10:19.970005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf9990-4ee2-4622-8456-42cec7882ef6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:20.067745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf9990-4ee2-4622-8456-42cec7882ef6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:20.100270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75111a97-9c9a-4b0f-a556-49f06f6818da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:20.100908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75111a97-9c9a-4b0f-a556-49f06f6818da None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:20.101211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75111a97-9c9a-4b0f-a556-49f06f6818da None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:20.101479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75111a97-9c9a-4b0f-a556-49f06f6818da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:20.102256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75111a97-9c9a-4b0f-a556-49f06f6818da None admin] RBAC: Adding query filter params (interface=public, service_id=108a75c68f27410a93318f547a4b0beb, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:20.102548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75111a97-9c9a-4b0f-a556-49f06f6818da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:20.103900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75111a97-9c9a-4b0f-a556-49f06f6818da None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:20.108856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 638/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Apr 12 14:10:19 2022] GET /identity/v3/endpoints?service_id=108a75c68f27410a93318f547a4b0beb&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:10:20.115636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5aee5-ec8b-48fa-9e6b-b719593ee77d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:20.212427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5aee5-ec8b-48fa-9e6b-b719593ee77d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:20.244592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda510a-b388-4b5f-a26f-e7fc1ee2208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:20.245280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda510a-b388-4b5f-a26f-e7fc1ee2208b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:20.245565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda510a-b388-4b5f-a26f-e7fc1ee2208b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:20.245840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda510a-b388-4b5f-a26f-e7fc1ee2208b None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:20.246512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda510a-b388-4b5f-a26f-e7fc1ee2208b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:20.247898 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda510a-b388-4b5f-a26f-e7fc1ee2208b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:20.254583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 663/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Apr 12 14:10:20 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:10:22.588978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae9c3-81e4-4188-9fc5-e0e4cc3d082d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:22.589512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae9c3-81e4-4188-9fc5-e0e4cc3d082d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:22.589605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae9c3-81e4-4188-9fc5-e0e4cc3d082d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:22.591294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 639/1302] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:10:22.597524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba84f5-de3b-453b-aa82-b797d7fd5857 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:22.597947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba84f5-de3b-453b-aa82-b797d7fd5857 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:22.598209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba84f5-de3b-453b-aa82-b797d7fd5857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:22.616507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-21ba84f5-de3b-453b-aa82-b797d7fd5857 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:10:22.619638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-21ba84f5-de3b-453b-aa82-b797d7fd5857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:10:22.683421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 664/1303] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:10:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 14:10:22.708943 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae9c3-81e4-4188-9fc5-e0e4cc3d082d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:22.807205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae9c3-81e4-4188-9fc5-e0e4cc3d082d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:22.839256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28333350-42fd-4f86-a555-b3a60b4c0820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:22.839970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28333350-42fd-4f86-a555-b3a60b4c0820 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:22.840246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28333350-42fd-4f86-a555-b3a60b4c0820 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:22.840511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28333350-42fd-4f86-a555-b3a60b4c0820 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:22.841232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28333350-42fd-4f86-a555-b3a60b4c0820 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:22.846634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28333350-42fd-4f86-a555-b3a60b4c0820 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:22.853919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.application [None req-28333350-42fd-4f86-a555-b3a60b4c0820 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 14:10:22.855056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 640/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Apr 12 14:10:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 14:10:22.861785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba84f5-de3b-453b-aa82-b797d7fd5857 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:22.955812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba84f5-de3b-453b-aa82-b797d7fd5857 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:22.988192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37248035-869c-427a-ba18-fd90446ba906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:22.988876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248035-869c-427a-ba18-fd90446ba906 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:22.989186 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248035-869c-427a-ba18-fd90446ba906 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:22.989461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248035-869c-427a-ba18-fd90446ba906 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:22.990200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37248035-869c-427a-ba18-fd90446ba906 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:10:22.990513 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37248035-869c-427a-ba18-fd90446ba906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:22.991864 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37248035-869c-427a-ba18-fd90446ba906 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:22.996847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 665/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Tue Apr 12 14:10:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:10:23.003525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28333350-42fd-4f86-a555-b3a60b4c0820 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:10:23.105846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28333350-42fd-4f86-a555-b3a60b4c0820 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:10:23.137237 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15290367-19d8-4f29-bdc7-499516400d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:10:23.137885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15290367-19d8-4f29-bdc7-499516400d5a None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:10:23.138168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15290367-19d8-4f29-bdc7-499516400d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:10:23.138443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15290367-19d8-4f29-bdc7-499516400d5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:10:23.139665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15290367-19d8-4f29-bdc7-499516400d5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:10:23.141042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15290367-19d8-4f29-bdc7-499516400d5a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:10:23.238633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 641/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Apr 12 14:10:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:16:46.474265 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762be81-50a3-4912-9b89-23d1a073c94f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:46.475395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762be81-50a3-4912-9b89-23d1a073c94f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:46.475827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762be81-50a3-4912-9b89-23d1a073c94f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:46.482742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd191c-eb8a-4dfe-a758-0c4466573bd6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:46.483557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd191c-eb8a-4dfe-a758-0c4466573bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:46.483989 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd191c-eb8a-4dfe-a758-0c4466573bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:46.487539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 666/1307] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:16:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:16:46.601290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7bcd191c-eb8a-4dfe-a758-0c4466573bd6 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:16:46.603147 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7bcd191c-eb8a-4dfe-a758-0c4466573bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:46.778353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 642/1308] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:16:46.823527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7bf9-22d3-44de-8ba3-505776967b6d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:46.824192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7bf9-22d3-44de-8ba3-505776967b6d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:46.824871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7bf9-22d3-44de-8ba3-505776967b6d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:46.826439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 667/1309] 10.222.0.61 () {54 vars in 964 bytes} [Tue Apr 12 14:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:16:46.832760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c733da4-0a88-4741-ad56-62e4845a0467 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:46.833170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c733da4-0a88-4741-ad56-62e4845a0467 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:46.833533 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c733da4-0a88-4741-ad56-62e4845a0467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:46.914759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6c733da4-0a88-4741-ad56-62e4845a0467 None None] MFA Rules not processed for user `fa7ee0856f4644c994c3ccbd400b6fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:16:46.915974 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6c733da4-0a88-4741-ad56-62e4845a0467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:47.002912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 643/1310] 10.222.0.61 () {58 vars in 1061 bytes} [Tue Apr 12 14:16:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:16:47.012649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7bf9-22d3-44de-8ba3-505776967b6d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:16:47.014423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5b2a7bf9-22d3-44de-8ba3-505776967b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:47.136332 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7bf9-22d3-44de-8ba3-505776967b6d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:16:47.211251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50c9f3-4e25-40ed-9412-019294674089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:16:47.211916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50c9f3-4e25-40ed-9412-019294674089 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:47.212203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50c9f3-4e25-40ed-9412-019294674089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:47.212486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50c9f3-4e25-40ed-9412-019294674089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:47.214295 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3f50c9f3-4e25-40ed-9412-019294674089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:47.329963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50c9f3-4e25-40ed-9412-019294674089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:16:47.331366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50c9f3-4e25-40ed-9412-019294674089 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:16:47.350762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 668/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:16:49.969347 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374a483-181f-4658-9e62-669b4afb28ff None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:49.969347 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374a483-181f-4658-9e62-669b4afb28ff None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:49.969347 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374a483-181f-4658-9e62-669b4afb28ff None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:49.970539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 644/1312] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:16:49.982069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4548d-0dfd-4b06-a1b2-06b566f02f23 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:49.982069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4548d-0dfd-4b06-a1b2-06b566f02f23 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:49.982069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4548d-0dfd-4b06-a1b2-06b566f02f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:50.057808 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fbf4548d-0dfd-4b06-a1b2-06b566f02f23 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:16:50.058942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fbf4548d-0dfd-4b06-a1b2-06b566f02f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:50.152535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 669/1313] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:16:50.191998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374a483-181f-4658-9e62-669b4afb28ff None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:16:50.194318 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a374a483-181f-4658-9e62-669b4afb28ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:50.294097 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374a483-181f-4658-9e62-669b4afb28ff None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:16:50.363565 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f8e99-b641-4ec7-896a-f50f0f5c1f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:16:50.364178 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8e99-b641-4ec7-896a-f50f0f5c1f81 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:50.364591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8e99-b641-4ec7-896a-f50f0f5c1f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:50.364710 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8e99-b641-4ec7-896a-f50f0f5c1f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:50.366949 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5a4f8e99-b641-4ec7-896a-f50f0f5c1f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:50.470631 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f8e99-b641-4ec7-896a-f50f0f5c1f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:16:50.472065 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f8e99-b641-4ec7-896a-f50f0f5c1f81 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:16:50.491176 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 645/1314] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:16:53.358770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60bfb3-2ab7-4681-a7d9-7f28a5e845c7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:53.359366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60bfb3-2ab7-4681-a7d9-7f28a5e845c7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:53.359366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60bfb3-2ab7-4681-a7d9-7f28a5e845c7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:53.360698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 670/1315] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:16:53.366724 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc176f9b-c748-42e8-85f5-19bee52cdf14 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:53.367224 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc176f9b-c748-42e8-85f5-19bee52cdf14 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:53.367370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc176f9b-c748-42e8-85f5-19bee52cdf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:53.433420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bc176f9b-c748-42e8-85f5-19bee52cdf14 None None] MFA Rules not processed for user `55c387b4a9af4a1d99f620de2f727870`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:16:53.434589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bc176f9b-c748-42e8-85f5-19bee52cdf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:53.529907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 646/1316] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:16:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:16:53.590317 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14b8ca-53ae-4d8f-bb99-e09867a5282b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:53.590772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14b8ca-53ae-4d8f-bb99-e09867a5282b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:53.591148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14b8ca-53ae-4d8f-bb99-e09867a5282b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:53.592647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 671/1317] 10.222.0.61 () {54 vars in 964 bytes} [Tue Apr 12 14:16:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:16:53.599880 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2522-3d41-4bcc-a5c8-c436aba84a33 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:53.600492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2522-3d41-4bcc-a5c8-c436aba84a33 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:53.600888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2522-3d41-4bcc-a5c8-c436aba84a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:53.680801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ed8d2522-3d41-4bcc-a5c8-c436aba84a33 None None] MFA Rules not processed for user `fa7ee0856f4644c994c3ccbd400b6fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:16:53.682044 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ed8d2522-3d41-4bcc-a5c8-c436aba84a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:53.759669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 647/1318] 10.222.0.61 () {58 vars in 1061 bytes} [Tue Apr 12 14:16:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:16:53.768588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14b8ca-53ae-4d8f-bb99-e09867a5282b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:16:53.770154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6e14b8ca-53ae-4d8f-bb99-e09867a5282b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:53.873356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14b8ca-53ae-4d8f-bb99-e09867a5282b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:16:53.948624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08770d9-33c2-4b29-bfed-b2bdb71ae810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:16:53.949698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08770d9-33c2-4b29-bfed-b2bdb71ae810 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:53.950033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08770d9-33c2-4b29-bfed-b2bdb71ae810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:53.950360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08770d9-33c2-4b29-bfed-b2bdb71ae810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:53.952037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c08770d9-33c2-4b29-bfed-b2bdb71ae810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:54.063628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08770d9-33c2-4b29-bfed-b2bdb71ae810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:16:54.065109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08770d9-33c2-4b29-bfed-b2bdb71ae810 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:16:54.084701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 672/1319] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:16:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:16:57.649478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd892f-b115-4c89-a89b-5b044624ffe2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:57.650011 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd892f-b115-4c89-a89b-5b044624ffe2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:57.650011 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd892f-b115-4c89-a89b-5b044624ffe2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:57.651413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 648/1320] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:16:57.656506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f52b1-bde0-484e-b173-f7bf10514810 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:57.658101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f52b1-bde0-484e-b173-f7bf10514810 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:57.658101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f52b1-bde0-484e-b173-f7bf10514810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:57.720877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-430f52b1-bde0-484e-b173-f7bf10514810 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:16:57.722096 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-430f52b1-bde0-484e-b173-f7bf10514810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:57.815714 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 673/1321] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:16:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:16:57.856296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd892f-b115-4c89-a89b-5b044624ffe2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:16:57.857851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cbdd892f-b115-4c89-a89b-5b044624ffe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:57.956217 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd892f-b115-4c89-a89b-5b044624ffe2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:16:58.026339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349a0a0-1860-4d5d-a08b-3638ecf32b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:16:58.026998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a0a0-1860-4d5d-a08b-3638ecf32b03 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:16:58.027285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a0a0-1860-4d5d-a08b-3638ecf32b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:16:58.027560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a0a0-1860-4d5d-a08b-3638ecf32b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:16:58.029246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1349a0a0-1860-4d5d-a08b-3638ecf32b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:16:58.133630 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349a0a0-1860-4d5d-a08b-3638ecf32b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:16:58.135051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349a0a0-1860-4d5d-a08b-3638ecf32b03 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:16:58.152694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 649/1322] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:16:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:01.471214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694f76-4506-4ad1-be8c-e55c1d3aa665 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:01.471742 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694f76-4506-4ad1-be8c-e55c1d3aa665 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:01.471742 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694f76-4506-4ad1-be8c-e55c1d3aa665 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:01.473156 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 674/1323] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:01.478817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcddb87-6482-4ee2-9402-cc16fe459907 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:01.479329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcddb87-6482-4ee2-9402-cc16fe459907 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:01.479423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcddb87-6482-4ee2-9402-cc16fe459907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:01.555198 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fdcddb87-6482-4ee2-9402-cc16fe459907 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:01.556328 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fdcddb87-6482-4ee2-9402-cc16fe459907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:01.656529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 650/1324] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:01.696248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c694f76-4506-4ad1-be8c-e55c1d3aa665 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:01.697820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1c694f76-4506-4ad1-be8c-e55c1d3aa665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:01.801147 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c694f76-4506-4ad1-be8c-e55c1d3aa665 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:01.883512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb3f52-283d-403c-8d95-eab9b0981473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:01.884171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb3f52-283d-403c-8d95-eab9b0981473 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:01.884451 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb3f52-283d-403c-8d95-eab9b0981473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:01.884717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb3f52-283d-403c-8d95-eab9b0981473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:01.886417 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-07bb3f52-283d-403c-8d95-eab9b0981473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:01.998360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb3f52-283d-403c-8d95-eab9b0981473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:01.999781 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb3f52-283d-403c-8d95-eab9b0981473 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:02.018161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 675/1325] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:04.428549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4061b2-e00d-4ffc-8561-6b7feaf0d280 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:04.429457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4061b2-e00d-4ffc-8561-6b7feaf0d280 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:04.429751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4061b2-e00d-4ffc-8561-6b7feaf0d280 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:04.431166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 651/1326] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:04.436598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05980d7b-f517-4e87-bc22-cb8b46174aec None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:04.437058 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05980d7b-f517-4e87-bc22-cb8b46174aec None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:04.437181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05980d7b-f517-4e87-bc22-cb8b46174aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:04.504794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-05980d7b-f517-4e87-bc22-cb8b46174aec None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:04.506573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-05980d7b-f517-4e87-bc22-cb8b46174aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:04.615721 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 676/1327] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:04.654209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4061b2-e00d-4ffc-8561-6b7feaf0d280 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:04.656175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0b4061b2-e00d-4ffc-8561-6b7feaf0d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:04.779955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4061b2-e00d-4ffc-8561-6b7feaf0d280 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:04.867682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca570dd-d436-4892-8a0a-db7766ad15e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:04.868329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca570dd-d436-4892-8a0a-db7766ad15e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:04.868606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca570dd-d436-4892-8a0a-db7766ad15e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:04.868877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca570dd-d436-4892-8a0a-db7766ad15e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:04.870548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7ca570dd-d436-4892-8a0a-db7766ad15e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:04.983150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca570dd-d436-4892-8a0a-db7766ad15e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:04.984590 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca570dd-d436-4892-8a0a-db7766ad15e9 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:05.002442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 652/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:07.371692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e497706-64ee-4d09-a036-daff7ef1b35d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:07.372195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e497706-64ee-4d09-a036-daff7ef1b35d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:07.372195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e497706-64ee-4d09-a036-daff7ef1b35d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:07.373578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 677/1329] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:07.378619 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ee1c-c999-4799-a61b-8b757a5a6c36 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:07.379024 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ee1c-c999-4799-a61b-8b757a5a6c36 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:07.379316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ee1c-c999-4799-a61b-8b757a5a6c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:07.443508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3db7ee1c-c999-4799-a61b-8b757a5a6c36 None None] MFA Rules not processed for user `55c387b4a9af4a1d99f620de2f727870`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:07.444706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3db7ee1c-c999-4799-a61b-8b757a5a6c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:07.539366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 653/1330] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:07.578437 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e497706-64ee-4d09-a036-daff7ef1b35d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:07.579971 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0e497706-64ee-4d09-a036-daff7ef1b35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:07.681345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e497706-64ee-4d09-a036-daff7ef1b35d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:07.755222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce99f30-8061-4ec7-aa7c-1ab7dfcb0a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:07.756412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce99f30-8061-4ec7-aa7c-1ab7dfcb0a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:07.756698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce99f30-8061-4ec7-aa7c-1ab7dfcb0a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:07.756986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce99f30-8061-4ec7-aa7c-1ab7dfcb0a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:07.758630 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1ce99f30-8061-4ec7-aa7c-1ab7dfcb0a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:07.865501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce99f30-8061-4ec7-aa7c-1ab7dfcb0a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:07.866933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce99f30-8061-4ec7-aa7c-1ab7dfcb0a66 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:07.884765 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 678/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:10.620554 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9564-965e-4382-9772-02e6781f506a None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:10.621191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9564-965e-4382-9772-02e6781f506a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:10.621785 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9564-965e-4382-9772-02e6781f506a None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:10.623225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 654/1332] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:10.629593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ab13d-01a7-4d40-bd46-3a9ec5bba959 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:10.631026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ab13d-01a7-4d40-bd46-3a9ec5bba959 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:10.631467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ab13d-01a7-4d40-bd46-3a9ec5bba959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:10.711783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ab4ab13d-01a7-4d40-bd46-3a9ec5bba959 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:10.713011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ab4ab13d-01a7-4d40-bd46-3a9ec5bba959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:10.817056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 679/1333] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:10.854849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9564-965e-4382-9772-02e6781f506a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:10.856465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-660e9564-965e-4382-9772-02e6781f506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:10.963890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9564-965e-4382-9772-02e6781f506a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:11.047673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a3207-afc6-4773-85c2-4fd8fc6165a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:11.048394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a3207-afc6-4773-85c2-4fd8fc6165a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:11.048717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a3207-afc6-4773-85c2-4fd8fc6165a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:11.049036 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a3207-afc6-4773-85c2-4fd8fc6165a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:11.050888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-835a3207-afc6-4773-85c2-4fd8fc6165a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:11.184335 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a3207-afc6-4773-85c2-4fd8fc6165a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:11.185898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a3207-afc6-4773-85c2-4fd8fc6165a5 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:11.205735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 655/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:13.602478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a7097-3df9-4bca-b8bd-88aaf2b556d1 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:13.603048 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a7097-3df9-4bca-b8bd-88aaf2b556d1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:13.603048 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a7097-3df9-4bca-b8bd-88aaf2b556d1 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:13.604407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 680/1335] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:13.609679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c708-d7c1-442e-977d-69f61de310b4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:13.610139 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c708-d7c1-442e-977d-69f61de310b4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:13.610324 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c708-d7c1-442e-977d-69f61de310b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:13.673955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d734c708-d7c1-442e-977d-69f61de310b4 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:13.675165 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d734c708-d7c1-442e-977d-69f61de310b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:13.774177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 656/1336] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:13.815399 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a7097-3df9-4bca-b8bd-88aaf2b556d1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:13.816938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5e2a7097-3df9-4bca-b8bd-88aaf2b556d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:13.919251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a7097-3df9-4bca-b8bd-88aaf2b556d1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:13.992059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6c193-0dc2-4b6a-a057-b75b23d07959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:13.992706 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6c193-0dc2-4b6a-a057-b75b23d07959 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:13.993011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6c193-0dc2-4b6a-a057-b75b23d07959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:13.993291 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6c193-0dc2-4b6a-a057-b75b23d07959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:13.994919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f3f6c193-0dc2-4b6a-a057-b75b23d07959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:14.098049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6c193-0dc2-4b6a-a057-b75b23d07959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:14.099544 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6c193-0dc2-4b6a-a057-b75b23d07959 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:14.117103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 681/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:17.137668 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91e898-a73f-42f2-ad4c-776717956438 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:17.138229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91e898-a73f-42f2-ad4c-776717956438 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:17.138229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91e898-a73f-42f2-ad4c-776717956438 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:17.139579 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 657/1338] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:17.144793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824dd77-663a-46db-87e6-9f48b647ba6b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:17.145243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824dd77-663a-46db-87e6-9f48b647ba6b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:17.145392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824dd77-663a-46db-87e6-9f48b647ba6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:17.212952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5824dd77-663a-46db-87e6-9f48b647ba6b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:17.214161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5824dd77-663a-46db-87e6-9f48b647ba6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:17.314303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 682/1339] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:17.350095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91e898-a73f-42f2-ad4c-776717956438 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:17.352171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1b91e898-a73f-42f2-ad4c-776717956438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:17.443005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91e898-a73f-42f2-ad4c-776717956438 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:17.446539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa449ad1-ec96-4f07-b774-b23e9d3093e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:17.447177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa449ad1-ec96-4f07-b774-b23e9d3093e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:17.447456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa449ad1-ec96-4f07-b774-b23e9d3093e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:17.447730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa449ad1-ec96-4f07-b774-b23e9d3093e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:17.456594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa449ad1-ec96-4f07-b774-b23e9d3093e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:17.458474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa449ad1-ec96-4f07-b774-b23e9d3093e1 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:17.467563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 658/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:17:22.113510 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90185a1-5e74-4174-8ed9-5077a91bb8e7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:22.114656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90185a1-5e74-4174-8ed9-5077a91bb8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:22.114656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90185a1-5e74-4174-8ed9-5077a91bb8e7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:22.116057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 683/1341] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:22.121461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ffda5-5653-44cc-8431-7229211ee739 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:22.121876 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ffda5-5653-44cc-8431-7229211ee739 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:22.122017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ffda5-5653-44cc-8431-7229211ee739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:22.150898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-455ffda5-5653-44cc-8431-7229211ee739 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:22.152099 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-455ffda5-5653-44cc-8431-7229211ee739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:22.227219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 659/1342] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:22.266125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90185a1-5e74-4174-8ed9-5077a91bb8e7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:22.276597 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90185a1-5e74-4174-8ed9-5077a91bb8e7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:22.280070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af3670-b831-4792-b1c7-e5099de97c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:22.280702 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3670-b831-4792-b1c7-e5099de97c40 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:22.281000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3670-b831-4792-b1c7-e5099de97c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:22.281278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3670-b831-4792-b1c7-e5099de97c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:22.289868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af3670-b831-4792-b1c7-e5099de97c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:22.291271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af3670-b831-4792-b1c7-e5099de97c40 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:22.300327 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 684/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:25.538750 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc44fa-880c-487d-94b2-5e445500e162 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:25.539278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc44fa-880c-487d-94b2-5e445500e162 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:25.539278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc44fa-880c-487d-94b2-5e445500e162 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:25.540546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 660/1344] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:25.545934 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed44be-8ef0-4475-b54b-2658620f509a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:25.546385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed44be-8ef0-4475-b54b-2658620f509a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:25.546644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed44be-8ef0-4475-b54b-2658620f509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:25.565284 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bbed44be-8ef0-4475-b54b-2658620f509a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:25.566472 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bbed44be-8ef0-4475-b54b-2658620f509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:25.574774 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 685/1345] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:25.614531 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc44fa-880c-487d-94b2-5e445500e162 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:25.624987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc44fa-880c-487d-94b2-5e445500e162 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:25.628402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f9cd3-49f5-4089-87a3-c8b5a341ff3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:25.629065 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f9cd3-49f5-4089-87a3-c8b5a341ff3e service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:25.629390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f9cd3-49f5-4089-87a3-c8b5a341ff3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:25.629807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f9cd3-49f5-4089-87a3-c8b5a341ff3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:25.638614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f9cd3-49f5-4089-87a3-c8b5a341ff3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:25.640027 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f9cd3-49f5-4089-87a3-c8b5a341ff3e service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:25.649509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 661/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:30.191669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0f01-83c9-42b9-acd0-12b976b24aa7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:30.192195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0f01-83c9-42b9-acd0-12b976b24aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:30.192282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0f01-83c9-42b9-acd0-12b976b24aa7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:30.193636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 686/1347] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:30.198858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f54777-7df4-463f-a6ec-3be30bf8ec6e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:30.199519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f54777-7df4-463f-a6ec-3be30bf8ec6e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:30.199800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f54777-7df4-463f-a6ec-3be30bf8ec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:30.217336 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e1f54777-7df4-463f-a6ec-3be30bf8ec6e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:30.218510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e1f54777-7df4-463f-a6ec-3be30bf8ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:30.227143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 662/1348] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:30.266513 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa0f01-83c9-42b9-acd0-12b976b24aa7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:30.277379 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa0f01-83c9-42b9-acd0-12b976b24aa7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:30.284993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1149a-8b96-4ae4-ad72-e565e74c439d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:30.286214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1149a-8b96-4ae4-ad72-e565e74c439d service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:30.286654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1149a-8b96-4ae4-ad72-e565e74c439d service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:30.287006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1149a-8b96-4ae4-ad72-e565e74c439d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:30.296752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1149a-8b96-4ae4-ad72-e565e74c439d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:30.298214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1149a-8b96-4ae4-ad72-e565e74c439d service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:30.308574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 687/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:35.849736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a0759-7af3-492e-9887-9deb5976114d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:35.850874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a0759-7af3-492e-9887-9deb5976114d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:35.851361 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a0759-7af3-492e-9887-9deb5976114d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:35.853271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 663/1350] 10.222.0.61 () {54 vars in 921 bytes} [Tue Apr 12 14:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:35.858384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5942b-722a-4dc9-a2ed-2ce28a2a645c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:35.859246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5942b-722a-4dc9-a2ed-2ce28a2a645c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:35.859718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5942b-722a-4dc9-a2ed-2ce28a2a645c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:35.934792 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-13b5942b-722a-4dc9-a2ed-2ce28a2a645c None None] MFA Rules not processed for user `3a7095f3ab8545c589d4d28a846ba1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:35.936422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-13b5942b-722a-4dc9-a2ed-2ce28a2a645c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:36.024050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 688/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Apr 12 14:17:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:40.612170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f5acd-f014-437c-8fda-6e640b6a97d0 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:40.613511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f5acd-f014-437c-8fda-6e640b6a97d0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:40.613938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f5acd-f014-437c-8fda-6e640b6a97d0 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:40.615893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 664/1352] 10.222.0.61 () {54 vars in 921 bytes} [Tue Apr 12 14:17:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:40.620940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ad313-e1b0-474c-982d-6f4a8ad216b5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:40.621424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ad313-e1b0-474c-982d-6f4a8ad216b5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:40.621748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ad313-e1b0-474c-982d-6f4a8ad216b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:40.641090 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-df7ad313-e1b0-474c-982d-6f4a8ad216b5 None None] MFA Rules not processed for user `3a7095f3ab8545c589d4d28a846ba1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:40.642274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-df7ad313-e1b0-474c-982d-6f4a8ad216b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:40.651705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 689/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Apr 12 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:42.204251 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a7f3-788c-49c5-929f-2cbffcffe62b None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:42.204777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a7f3-788c-49c5-929f-2cbffcffe62b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:42.204777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a7f3-788c-49c5-929f-2cbffcffe62b None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:42.206471 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 665/1354] 10.222.0.61 () {54 vars in 921 bytes} [Tue Apr 12 14:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:42.211840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aa795-8d68-4cc2-b92e-71ec4a4079d8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:42.212289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aa795-8d68-4cc2-b92e-71ec4a4079d8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:42.212534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aa795-8d68-4cc2-b92e-71ec4a4079d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:42.231459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-233aa795-8d68-4cc2-b92e-71ec4a4079d8 None None] MFA Rules not processed for user `3a7095f3ab8545c589d4d28a846ba1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:42.232666 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-233aa795-8d68-4cc2-b92e-71ec4a4079d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:42.242424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 690/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Apr 12 14:17:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:17:46.120748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29e1d-a901-42a7-839b-69dc2829ca36 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:46.121332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29e1d-a901-42a7-839b-69dc2829ca36 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:46.121607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29e1d-a901-42a7-839b-69dc2829ca36 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:46.124622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 666/1356] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:46.128097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d81a01-b722-4f77-bd35-61a7f6e4e485 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:46.128543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d81a01-b722-4f77-bd35-61a7f6e4e485 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:46.129168 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d81a01-b722-4f77-bd35-61a7f6e4e485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:46.147019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-46d81a01-b722-4f77-bd35-61a7f6e4e485 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:46.148199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-46d81a01-b722-4f77-bd35-61a7f6e4e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:46.155967 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 691/1357] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:46.206803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f91b-d465-4377-ac13-1e0b4761c31d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:46.207092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f91b-d465-4377-ac13-1e0b4761c31d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:46.207539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f91b-d465-4377-ac13-1e0b4761c31d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:46.208898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 667/1358] 10.222.0.61 () {54 vars in 960 bytes} [Tue Apr 12 14:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:46.214576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b5d53-8ee1-4f14-9b79-06742468facc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:46.215001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b5d53-8ee1-4f14-9b79-06742468facc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:46.215501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b5d53-8ee1-4f14-9b79-06742468facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:46.287557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5f9b5d53-8ee1-4f14-9b79-06742468facc None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:46.289001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5f9b5d53-8ee1-4f14-9b79-06742468facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:46.377438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 692/1359] 10.222.0.61 () {58 vars in 1057 bytes} [Tue Apr 12 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:46.385851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f91b-d465-4377-ac13-1e0b4761c31d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:46.401500 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f91b-d465-4377-ac13-1e0b4761c31d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:46.407046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bea14-fe8b-4957-a01b-8fc3a39c6dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:46.407790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bea14-fe8b-4957-a01b-8fc3a39c6dda service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:46.408170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bea14-fe8b-4957-a01b-8fc3a39c6dda service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:46.408545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bea14-fe8b-4957-a01b-8fc3a39c6dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:46.417935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bea14-fe8b-4957-a01b-8fc3a39c6dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:46.419635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bea14-fe8b-4957-a01b-8fc3a39c6dda service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:46.429415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 668/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:17:48.989514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5c8bb-c6b4-46cf-8e93-be484bbf1f2a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:48.990069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5c8bb-c6b4-46cf-8e93-be484bbf1f2a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:48.990069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5c8bb-c6b4-46cf-8e93-be484bbf1f2a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:48.993019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 693/1361] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:48.997057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44324946-e9f2-40ce-bc93-cac234a57751 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:48.997490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44324946-e9f2-40ce-bc93-cac234a57751 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:48.997729 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44324946-e9f2-40ce-bc93-cac234a57751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:49.016229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-44324946-e9f2-40ce-bc93-cac234a57751 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:49.017514 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-44324946-e9f2-40ce-bc93-cac234a57751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:49.026957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 669/1362] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:17:49.073938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5c8bb-c6b4-46cf-8e93-be484bbf1f2a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:49.088288 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5c8bb-c6b4-46cf-8e93-be484bbf1f2a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:49.093798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40709f45-6d50-4d06-8e40-0ef43101e9be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:49.094453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709f45-6d50-4d06-8e40-0ef43101e9be service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:49.094856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709f45-6d50-4d06-8e40-0ef43101e9be service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:49.095137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709f45-6d50-4d06-8e40-0ef43101e9be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:49.104498 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40709f45-6d50-4d06-8e40-0ef43101e9be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:49.106100 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40709f45-6d50-4d06-8e40-0ef43101e9be service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:49.117148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 694/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:51.915889 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c0b77-368d-4813-a7ec-72a9aeea6ff2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:51.916440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c0b77-368d-4813-a7ec-72a9aeea6ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:51.916440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c0b77-368d-4813-a7ec-72a9aeea6ff2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:51.917815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 670/1364] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:51.923061 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f73c2-005c-4db2-9f6a-7f6c5e4fb06e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:51.923469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f73c2-005c-4db2-9f6a-7f6c5e4fb06e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:51.923622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f73c2-005c-4db2-9f6a-7f6c5e4fb06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:51.942925 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b69f73c2-005c-4db2-9f6a-7f6c5e4fb06e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:51.944183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b69f73c2-005c-4db2-9f6a-7f6c5e4fb06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:51.952999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 695/1365] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:52.014510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b6c33-2820-46c8-bf3e-e542b5d4b8b6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:52.015149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b6c33-2820-46c8-bf3e-e542b5d4b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:52.015643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b6c33-2820-46c8-bf3e-e542b5d4b8b6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:52.017945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 671/1366] 10.222.0.61 () {54 vars in 960 bytes} [Tue Apr 12 14:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:52.025575 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a283fd5-c9a0-4976-9fad-0772755fb981 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:52.025911 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a283fd5-c9a0-4976-9fad-0772755fb981 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:52.026146 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a283fd5-c9a0-4976-9fad-0772755fb981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:52.050457 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4a283fd5-c9a0-4976-9fad-0772755fb981 None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:52.052020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4a283fd5-c9a0-4976-9fad-0772755fb981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:52.063724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 696/1367] 10.222.0.61 () {58 vars in 1057 bytes} [Tue Apr 12 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:52.073306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b6c33-2820-46c8-bf3e-e542b5d4b8b6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:52.091491 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b6c33-2820-46c8-bf3e-e542b5d4b8b6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:52.098341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6417c-a83b-4330-bc6e-61bd33763013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:52.099277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6417c-a83b-4330-bc6e-61bd33763013 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:52.099785 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6417c-a83b-4330-bc6e-61bd33763013 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:52.100280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6417c-a83b-4330-bc6e-61bd33763013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:52.110413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6417c-a83b-4330-bc6e-61bd33763013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:52.111892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6417c-a83b-4330-bc6e-61bd33763013 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:52.123463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 672/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:54.472521 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394977-a5ab-4725-9f6d-afef56dc473a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:54.473075 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394977-a5ab-4725-9f6d-afef56dc473a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:54.473075 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394977-a5ab-4725-9f6d-afef56dc473a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:54.474621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 697/1369] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:54.479751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875bb9b-7e7e-4bff-a5c1-41f949c25b84 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:54.480151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875bb9b-7e7e-4bff-a5c1-41f949c25b84 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:54.480307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875bb9b-7e7e-4bff-a5c1-41f949c25b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:54.498551 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0875bb9b-7e7e-4bff-a5c1-41f949c25b84 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:54.499751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0875bb9b-7e7e-4bff-a5c1-41f949c25b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:54.508046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 673/1370] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:54.752059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde3bb-c9a9-4902-bb53-ebe54dab3c62 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:54.752262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde3bb-c9a9-4902-bb53-ebe54dab3c62 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:54.753257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde3bb-c9a9-4902-bb53-ebe54dab3c62 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:54.754633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 698/1371] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:54.760065 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef901-8827-4a1c-9ef8-0fd4537e1c48 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:54.760358 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef901-8827-4a1c-9ef8-0fd4537e1c48 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:54.760638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef901-8827-4a1c-9ef8-0fd4537e1c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:54.779049 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3cdef901-8827-4a1c-9ef8-0fd4537e1c48 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:54.780241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3cdef901-8827-4a1c-9ef8-0fd4537e1c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:54.789818 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 674/1372] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:54.836885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1b27d-bc28-4c5e-b9cd-175441a5ce3b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:54.837154 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdef901-8827-4a1c-9ef8-0fd4537e1c48 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:54.837445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1b27d-bc28-4c5e-b9cd-175441a5ce3b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:54.837883 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1b27d-bc28-4c5e-b9cd-175441a5ce3b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:54.839405 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 699/1373] 10.222.0.61 () {54 vars in 962 bytes} [Tue Apr 12 14:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:54.844300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6720f0-9758-4e94-b5cf-6eb378aa3810 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:54.844690 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6720f0-9758-4e94-b5cf-6eb378aa3810 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:54.845638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6720f0-9758-4e94-b5cf-6eb378aa3810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:54.849819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdef901-8827-4a1c-9ef8-0fd4537e1c48 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:54.855451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e5e12-6e3e-4f74-bcb2-35efb4226045 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:54.856158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e5e12-6e3e-4f74-bcb2-35efb4226045 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:54.856385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e5e12-6e3e-4f74-bcb2-35efb4226045 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:54.856661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e5e12-6e3e-4f74-bcb2-35efb4226045 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:54.865439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e5e12-6e3e-4f74-bcb2-35efb4226045 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:54.867046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e5e12-6e3e-4f74-bcb2-35efb4226045 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:54.877289 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 675/1374] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:54.900722 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fa6720f0-9758-4e94-b5cf-6eb378aa3810 None None] MFA Rules not processed for user `c6ca11a750dc4234b4512e6274ca01a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:54.902031 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fa6720f0-9758-4e94-b5cf-6eb378aa3810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:54.963709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 700/1375] 10.222.0.61 () {58 vars in 1059 bytes} [Tue Apr 12 14:17:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:17:54.972858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e5e12-6e3e-4f74-bcb2-35efb4226045 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:54.988326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e5e12-6e3e-4f74-bcb2-35efb4226045 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:54.992607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59751f-8699-4d49-9064-1cfd124d6474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:54.993407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59751f-8699-4d49-9064-1cfd124d6474 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:54.993667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59751f-8699-4d49-9064-1cfd124d6474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:54.993907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59751f-8699-4d49-9064-1cfd124d6474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:55.004887 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59751f-8699-4d49-9064-1cfd124d6474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:55.006404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59751f-8699-4d49-9064-1cfd124d6474 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:55.017039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 676/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:17:57.469652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eec02e-8598-49ef-9d8f-1c0e982e522d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:57.470178 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eec02e-8598-49ef-9d8f-1c0e982e522d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:57.470278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eec02e-8598-49ef-9d8f-1c0e982e522d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:57.472356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 701/1377] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:17:57.477952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d36721-6003-4dfc-9c0e-6114debb2311 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:57.478412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d36721-6003-4dfc-9c0e-6114debb2311 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:57.478504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d36721-6003-4dfc-9c0e-6114debb2311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:57.497089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-74d36721-6003-4dfc-9c0e-6114debb2311 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:17:57.498300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-74d36721-6003-4dfc-9c0e-6114debb2311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:17:57.506365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 677/1378] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:17:57.552609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eec02e-8598-49ef-9d8f-1c0e982e522d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:17:57.567641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eec02e-8598-49ef-9d8f-1c0e982e522d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:17:57.573200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a4ff4-b2e2-42f3-b666-6269c445d162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:17:57.574102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a4ff4-b2e2-42f3-b666-6269c445d162 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:17:57.574382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a4ff4-b2e2-42f3-b666-6269c445d162 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:17:57.574656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a4ff4-b2e2-42f3-b666-6269c445d162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:17:57.584245 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a4ff4-b2e2-42f3-b666-6269c445d162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:17:57.586583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a4ff4-b2e2-42f3-b666-6269c445d162 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:17:57.596793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 702/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:00.098567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bfa21-837f-46b2-b1ae-0eff13323a3f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:00.099069 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bfa21-837f-46b2-b1ae-0eff13323a3f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:00.099069 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bfa21-837f-46b2-b1ae-0eff13323a3f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:00.100395 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 678/1380] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:00.105807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21fca1-1988-4364-8584-8b7626e46343 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:00.106246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21fca1-1988-4364-8584-8b7626e46343 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:00.106452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21fca1-1988-4364-8584-8b7626e46343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:00.126412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ce21fca1-1988-4364-8584-8b7626e46343 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:00.127606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ce21fca1-1988-4364-8584-8b7626e46343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:00.136466 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 703/1381] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:00.181792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bfa21-837f-46b2-b1ae-0eff13323a3f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:00.197314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bfa21-837f-46b2-b1ae-0eff13323a3f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:00.203323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c180e-d401-463f-8f5a-ed9ac7398f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:00.203991 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c180e-d401-463f-8f5a-ed9ac7398f53 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:00.204340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c180e-d401-463f-8f5a-ed9ac7398f53 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:00.204629 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c180e-d401-463f-8f5a-ed9ac7398f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:00.215959 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c180e-d401-463f-8f5a-ed9ac7398f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:00.217898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c180e-d401-463f-8f5a-ed9ac7398f53 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:00.228186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 679/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:02.773116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175debf-614d-4f87-9642-68773805446d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:02.773679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175debf-614d-4f87-9642-68773805446d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:02.773679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175debf-614d-4f87-9642-68773805446d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:02.775237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 704/1383] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:02.780350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661b650-a8d5-4971-bfbb-b07be40d660d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:02.780776 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661b650-a8d5-4971-bfbb-b07be40d660d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:02.781008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661b650-a8d5-4971-bfbb-b07be40d660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:02.800165 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b661b650-a8d5-4971-bfbb-b07be40d660d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:02.801711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b661b650-a8d5-4971-bfbb-b07be40d660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:02.809786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 680/1384] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:02.854477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175debf-614d-4f87-9642-68773805446d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:02.869942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175debf-614d-4f87-9642-68773805446d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:02.875733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c7607-4e73-4e7a-b873-68efb6314caa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:02.876529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c7607-4e73-4e7a-b873-68efb6314caa service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:02.877051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c7607-4e73-4e7a-b873-68efb6314caa service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:02.877439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c7607-4e73-4e7a-b873-68efb6314caa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:02.886695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c7607-4e73-4e7a-b873-68efb6314caa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:02.888409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c7607-4e73-4e7a-b873-68efb6314caa service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:02.899188 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 705/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:05.534191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e562c2-cd4f-4386-a6fb-3de839207ae4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:05.534837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e562c2-cd4f-4386-a6fb-3de839207ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:05.534837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e562c2-cd4f-4386-a6fb-3de839207ae4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:05.536439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 681/1386] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:05.542996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fcdac-88d1-43e5-88a6-b301481c5992 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:05.543780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fcdac-88d1-43e5-88a6-b301481c5992 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:05.544309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fcdac-88d1-43e5-88a6-b301481c5992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:05.570598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a62fcdac-88d1-43e5-88a6-b301481c5992 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:05.572656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a62fcdac-88d1-43e5-88a6-b301481c5992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:05.585096 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 706/1387] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:05.639617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e562c2-cd4f-4386-a6fb-3de839207ae4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:05.660300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e562c2-cd4f-4386-a6fb-3de839207ae4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:05.666078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494f738-4aba-45bc-8466-7d2a16494970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:05.666957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494f738-4aba-45bc-8466-7d2a16494970 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:05.667426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494f738-4aba-45bc-8466-7d2a16494970 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:05.668233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494f738-4aba-45bc-8466-7d2a16494970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:05.677501 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494f738-4aba-45bc-8466-7d2a16494970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:05.679086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494f738-4aba-45bc-8466-7d2a16494970 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:05.690321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 682/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:08.297124 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7751a-5bfa-4f49-a8e2-2391cc222daa None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:08.297657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7751a-5bfa-4f49-a8e2-2391cc222daa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:08.297938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7751a-5bfa-4f49-a8e2-2391cc222daa None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:08.300421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 707/1389] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:18:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:08.306164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfcb51-c9e3-40eb-90b3-6b7f10be23a5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:08.306582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfcb51-c9e3-40eb-90b3-6b7f10be23a5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:08.306750 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfcb51-c9e3-40eb-90b3-6b7f10be23a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:08.326163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c4bfcb51-c9e3-40eb-90b3-6b7f10be23a5 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:08.327443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c4bfcb51-c9e3-40eb-90b3-6b7f10be23a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:08.336064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 683/1390] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:18:08.382771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7751a-5bfa-4f49-a8e2-2391cc222daa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:08.401036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7751a-5bfa-4f49-a8e2-2391cc222daa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:08.408425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4c6a0-14a7-451c-8a1f-041005bff307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:08.409388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4c6a0-14a7-451c-8a1f-041005bff307 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:08.409746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4c6a0-14a7-451c-8a1f-041005bff307 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:08.410102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4c6a0-14a7-451c-8a1f-041005bff307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:08.421039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4c6a0-14a7-451c-8a1f-041005bff307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:08.423092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4c6a0-14a7-451c-8a1f-041005bff307 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:08.436629 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 708/1391] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:11.100166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297d949-fd18-459f-b587-87c67d63ed4c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:11.100731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297d949-fd18-459f-b587-87c67d63ed4c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:11.100731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297d949-fd18-459f-b587-87c67d63ed4c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:11.102188 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 684/1392] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:18:11.107321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea2e7e-b9e5-4b6a-a659-620d139f011f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:11.107906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea2e7e-b9e5-4b6a-a659-620d139f011f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:11.107906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea2e7e-b9e5-4b6a-a659-620d139f011f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:11.126246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-18ea2e7e-b9e5-4b6a-a659-620d139f011f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:11.128029 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-18ea2e7e-b9e5-4b6a-a659-620d139f011f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:11.136137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 709/1393] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:11.182034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297d949-fd18-459f-b587-87c67d63ed4c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:11.197314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297d949-fd18-459f-b587-87c67d63ed4c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:11.203144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53426de9-829e-4a8b-84d6-6a588de7def8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:11.203796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53426de9-829e-4a8b-84d6-6a588de7def8 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:11.204080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53426de9-829e-4a8b-84d6-6a588de7def8 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:11.204358 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53426de9-829e-4a8b-84d6-6a588de7def8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:11.213394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53426de9-829e-4a8b-84d6-6a588de7def8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:11.215005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53426de9-829e-4a8b-84d6-6a588de7def8 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:11.226435 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 685/1394] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:11.615708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4f88d-1b02-443e-9c33-199dd0f0ff5f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:11.616022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4f88d-1b02-443e-9c33-199dd0f0ff5f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:11.616281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4f88d-1b02-443e-9c33-199dd0f0ff5f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:11.617767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 710/1395] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:11.623490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f4b4-a3a7-44d9-8fdd-223f1470c06d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:11.623800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f4b4-a3a7-44d9-8fdd-223f1470c06d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:11.624077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f4b4-a3a7-44d9-8fdd-223f1470c06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:11.642799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c526f4b4-a3a7-44d9-8fdd-223f1470c06d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:11.644214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c526f4b4-a3a7-44d9-8fdd-223f1470c06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:11.652563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 686/1396] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:18:11.712579 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fceb02-e0be-47ce-ad44-f4290cb833b1 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:11.715400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fceb02-e0be-47ce-ad44-f4290cb833b1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:11.715400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fceb02-e0be-47ce-ad44-f4290cb833b1 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:11.715400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 711/1397] 10.222.0.61 () {54 vars in 961 bytes} [Tue Apr 12 14:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:11.719976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32140da-7332-4bfb-bc10-e689abd557c2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:11.720889 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32140da-7332-4bfb-bc10-e689abd557c2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:11.721492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32140da-7332-4bfb-bc10-e689abd557c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:11.770568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d32140da-7332-4bfb-bc10-e689abd557c2 None None] MFA Rules not processed for user `21ef8bbd229c488d97f167c810bc7cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:11.771791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d32140da-7332-4bfb-bc10-e689abd557c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:11.832803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 687/1398] 10.222.0.61 () {58 vars in 1058 bytes} [Tue Apr 12 14:18:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:11.840507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fceb02-e0be-47ce-ad44-f4290cb833b1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:11.851826 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fceb02-e0be-47ce-ad44-f4290cb833b1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:11.855268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380e205-060e-45a6-99cd-6887d58b553b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef8bbd229c488d97f167c810bc7cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:11.855900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380e205-060e-45a6-99cd-6887d58b553b service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:11.856180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380e205-060e-45a6-99cd-6887d58b553b service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:11.856456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380e205-060e-45a6-99cd-6887d58b553b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:11.865894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380e205-060e-45a6-99cd-6887d58b553b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:11.867492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380e205-060e-45a6-99cd-6887d58b553b service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:11.877988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 712/1399] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:12.444244 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968409-9111-460d-af76-4944a600dd31 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:12.444794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968409-9111-460d-af76-4944a600dd31 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:12.444794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64968409-9111-460d-af76-4944a600dd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:12.498752 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-64968409-9111-460d-af76-4944a600dd31 None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:12.500153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-64968409-9111-460d-af76-4944a600dd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:12.569453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 688/1400] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:18:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:12.616687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5aadc-3f11-4bfb-b737-1d5d453d20ef None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:12.622225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5aadc-3f11-4bfb-b737-1d5d453d20ef None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:12.622225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5aadc-3f11-4bfb-b737-1d5d453d20ef None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:12.622225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 713/1401] 10.222.0.61 () {54 vars in 942 bytes} [Tue Apr 12 14:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:12.626402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf19ed-d1bf-411a-b53d-bef0e7b2c58d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:12.627491 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf19ed-d1bf-411a-b53d-bef0e7b2c58d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:12.627988 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf19ed-d1bf-411a-b53d-bef0e7b2c58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:12.683151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4abf19ed-d1bf-411a-b53d-bef0e7b2c58d None None] MFA Rules not processed for user `987dcad83b914b5894955dfe3e1f71ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:12.684348 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4abf19ed-d1bf-411a-b53d-bef0e7b2c58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:12.773917 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 689/1402] 10.222.0.61 () {58 vars in 1039 bytes} [Tue Apr 12 14:18:12 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:12.782675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5aadc-3f11-4bfb-b737-1d5d453d20ef None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:12.798961 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5aadc-3f11-4bfb-b737-1d5d453d20ef None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:12.804392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53130f56-b086-4ab9-bdd6-30ed29324328 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:12.805156 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53130f56-b086-4ab9-bdd6-30ed29324328 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:12.805503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53130f56-b086-4ab9-bdd6-30ed29324328 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:12.805841 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53130f56-b086-4ab9-bdd6-30ed29324328 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:12.815825 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53130f56-b086-4ab9-bdd6-30ed29324328 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:12.818990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53130f56-b086-4ab9-bdd6-30ed29324328 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:12.828191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 714/1403] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:18:13.722778 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11298c70-1d50-43e2-b288-6b54a08b1253 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:13.723298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11298c70-1d50-43e2-b288-6b54a08b1253 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:13.723380 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11298c70-1d50-43e2-b288-6b54a08b1253 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:13.725693 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 690/1404] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:13.732655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9453a7-eebd-46fe-8524-8354120ac870 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:13.732655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9453a7-eebd-46fe-8524-8354120ac870 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:13.732655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9453a7-eebd-46fe-8524-8354120ac870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:13.753448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1b9453a7-eebd-46fe-8524-8354120ac870 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:13.755069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1b9453a7-eebd-46fe-8524-8354120ac870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:13.763488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 715/1405] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:13.810848 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11298c70-1d50-43e2-b288-6b54a08b1253 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:13.831342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11298c70-1d50-43e2-b288-6b54a08b1253 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:13.837478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b1cb7-6310-4391-96e8-943a8ed93498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:13.838220 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b1cb7-6310-4391-96e8-943a8ed93498 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:13.838568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b1cb7-6310-4391-96e8-943a8ed93498 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:13.838918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b1cb7-6310-4391-96e8-943a8ed93498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:13.847991 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b1cb7-6310-4391-96e8-943a8ed93498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:13.849621 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b1cb7-6310-4391-96e8-943a8ed93498 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:13.869143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 691/1406] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:16.453649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f17f3e-2b57-4ebf-bd36-7b0efe6e3985 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:16.455139 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f17f3e-2b57-4ebf-bd36-7b0efe6e3985 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:16.456107 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f17f3e-2b57-4ebf-bd36-7b0efe6e3985 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:16.457601 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 716/1407] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:16.463121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230e49f-d257-4353-a071-d8336fcd594e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:16.463580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230e49f-d257-4353-a071-d8336fcd594e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:16.463785 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230e49f-d257-4353-a071-d8336fcd594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:16.483915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8230e49f-d257-4353-a071-d8336fcd594e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:16.485170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8230e49f-d257-4353-a071-d8336fcd594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:16.494074 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 692/1408] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:16.539782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f17f3e-2b57-4ebf-bd36-7b0efe6e3985 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:16.558051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f17f3e-2b57-4ebf-bd36-7b0efe6e3985 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:16.565553 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b41d2-ab52-493c-9681-d7887c4bd241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:16.566519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b41d2-ab52-493c-9681-d7887c4bd241 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:16.566804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b41d2-ab52-493c-9681-d7887c4bd241 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:16.567085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b41d2-ab52-493c-9681-d7887c4bd241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:16.584799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b41d2-ab52-493c-9681-d7887c4bd241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:16.586606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b41d2-ab52-493c-9681-d7887c4bd241 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:16.598097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 717/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:37.610085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29dd9-efac-49d2-a468-6398aed6b814 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:37.611441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29dd9-efac-49d2-a468-6398aed6b814 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:37.611441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29dd9-efac-49d2-a468-6398aed6b814 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:37.612038 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 693/1410] 10.222.0.61 () {54 vars in 918 bytes} [Tue Apr 12 14:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:37.617655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c839d-30f9-4817-b22d-06084e2ed6dc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:37.627866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c839d-30f9-4817-b22d-06084e2ed6dc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:37.627866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c839d-30f9-4817-b22d-06084e2ed6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:37.637049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-518c839d-30f9-4817-b22d-06084e2ed6dc None None] MFA Rules not processed for user `3a7095f3ab8545c589d4d28a846ba1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:37.638258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-518c839d-30f9-4817-b22d-06084e2ed6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:37.647355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 718/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Tue Apr 12 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:37.662284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46b83-3852-4a97-b283-bedcf17f1bea None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:37.663809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46b83-3852-4a97-b283-bedcf17f1bea None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:37.663809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46b83-3852-4a97-b283-bedcf17f1bea None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:37.664626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 694/1412] 10.222.0.61 () {54 vars in 918 bytes} [Tue Apr 12 14:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:37.669776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250cea-202d-4a12-b621-3f8eda78e0ea None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:37.670071 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250cea-202d-4a12-b621-3f8eda78e0ea None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:37.670349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250cea-202d-4a12-b621-3f8eda78e0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:37.688840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e4250cea-202d-4a12-b621-3f8eda78e0ea None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:37.690077 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e4250cea-202d-4a12-b621-3f8eda78e0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:37.699388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 719/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Tue Apr 12 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:40.523230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed044d06-0839-4b99-919b-cd8bd13d8786 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:40.523810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed044d06-0839-4b99-919b-cd8bd13d8786 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:40.523810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed044d06-0839-4b99-919b-cd8bd13d8786 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:40.525135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:40.530350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9a434-7750-446c-9a1c-fdb82435e877 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:40.530808 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9a434-7750-446c-9a1c-fdb82435e877 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:40.530912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9a434-7750-446c-9a1c-fdb82435e877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:40.549492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6cd9a434-7750-446c-9a1c-fdb82435e877 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:40.550723 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6cd9a434-7750-446c-9a1c-fdb82435e877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:40.558651 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:18:40.602382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed044d06-0839-4b99-919b-cd8bd13d8786 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:40.617105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed044d06-0839-4b99-919b-cd8bd13d8786 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:40.622477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef98aa-4ddc-4e22-bd2d-4276d9b94221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:40.623114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef98aa-4ddc-4e22-bd2d-4276d9b94221 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:40.623398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef98aa-4ddc-4e22-bd2d-4276d9b94221 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:40.623677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef98aa-4ddc-4e22-bd2d-4276d9b94221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:40.634290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef98aa-4ddc-4e22-bd2d-4276d9b94221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:40.635861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef98aa-4ddc-4e22-bd2d-4276d9b94221 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:40.645171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 696/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:42.010698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9200802-d852-426e-bf64-e50558ed6b3c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:42.011250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9200802-d852-426e-bf64-e50558ed6b3c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:42.011250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9200802-d852-426e-bf64-e50558ed6b3c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:42.012512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:42.021856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1396d79-aaad-4a97-9ca0-76b0c52b6aae None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:42.022379 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1396d79-aaad-4a97-9ca0-76b0c52b6aae None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:42.022513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1396d79-aaad-4a97-9ca0-76b0c52b6aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:42.041354 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b1396d79-aaad-4a97-9ca0-76b0c52b6aae None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:42.042546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b1396d79-aaad-4a97-9ca0-76b0c52b6aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:42.050793 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:42.221848 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9200802-d852-426e-bf64-e50558ed6b3c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:42.235746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9200802-d852-426e-bf64-e50558ed6b3c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:42.241010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96052fb-c45f-45aa-8418-2c16a6d6fb18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:42.241643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96052fb-c45f-45aa-8418-2c16a6d6fb18 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:42.241926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96052fb-c45f-45aa-8418-2c16a6d6fb18 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:42.242198 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96052fb-c45f-45aa-8418-2c16a6d6fb18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:42.250281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96052fb-c45f-45aa-8418-2c16a6d6fb18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:42.252533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96052fb-c45f-45aa-8418-2c16a6d6fb18 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:42.261944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 722/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:43.583743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf4a7-7085-423b-9fa0-2c2ae29204a6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:43.584309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf4a7-7085-423b-9fa0-2c2ae29204a6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:43.584309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf4a7-7085-423b-9fa0-2c2ae29204a6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:43.585688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:43.590800 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee890a-905a-4987-887b-d00604ecf6b0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:43.591244 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee890a-905a-4987-887b-d00604ecf6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:43.591361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee890a-905a-4987-887b-d00604ecf6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:43.610909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-12ee890a-905a-4987-887b-d00604ecf6b0 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:43.612093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-12ee890a-905a-4987-887b-d00604ecf6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:43.620269 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:43.777936 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebf4a7-7085-423b-9fa0-2c2ae29204a6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:43.792477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebf4a7-7085-423b-9fa0-2c2ae29204a6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:43.798043 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e4567-c1c1-4aa3-b4a3-729db6898c20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:43.798697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e4567-c1c1-4aa3-b4a3-729db6898c20 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:43.798979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e4567-c1c1-4aa3-b4a3-729db6898c20 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:43.799263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e4567-c1c1-4aa3-b4a3-729db6898c20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:43.808033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e4567-c1c1-4aa3-b4a3-729db6898c20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:43.809657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e4567-c1c1-4aa3-b4a3-729db6898c20 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:43.819741 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 699/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:45.140430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b064-f7d8-405d-851d-5011e40b4c3e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:45.141074 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b064-f7d8-405d-851d-5011e40b4c3e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:45.141074 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b064-f7d8-405d-851d-5011e40b4c3e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:45.142430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:45.147548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d983-692a-47be-b223-60c4c7b8803c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:45.148022 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d983-692a-47be-b223-60c4c7b8803c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:45.148132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d983-692a-47be-b223-60c4c7b8803c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:45.166351 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a550d983-692a-47be-b223-60c4c7b8803c None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:45.167543 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a550d983-692a-47be-b223-60c4c7b8803c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:45.176017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:45.327063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86b064-f7d8-405d-851d-5011e40b4c3e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:45.342583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86b064-f7d8-405d-851d-5011e40b4c3e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:45.348061 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901af2f-8ef6-42de-844c-4b9454c630ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:45.348698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901af2f-8ef6-42de-844c-4b9454c630ff service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:45.349000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901af2f-8ef6-42de-844c-4b9454c630ff service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:45.349280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901af2f-8ef6-42de-844c-4b9454c630ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:45.357357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901af2f-8ef6-42de-844c-4b9454c630ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:45.358929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901af2f-8ef6-42de-844c-4b9454c630ff service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:45.368892 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 725/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:46.687235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9662d5f-0604-4e05-a4ea-af8814a603bc None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:46.687819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9662d5f-0604-4e05-a4ea-af8814a603bc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:46.687819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9662d5f-0604-4e05-a4ea-af8814a603bc None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:46.689253 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:46.694422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f495cc-68b5-491e-9e3a-7bd566ad434c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:46.694886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f495cc-68b5-491e-9e3a-7bd566ad434c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:46.694979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f495cc-68b5-491e-9e3a-7bd566ad434c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:46.713310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f8f495cc-68b5-491e-9e3a-7bd566ad434c None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:46.714541 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f8f495cc-68b5-491e-9e3a-7bd566ad434c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:46.723369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:46.873307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9662d5f-0604-4e05-a4ea-af8814a603bc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:46.887758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9662d5f-0604-4e05-a4ea-af8814a603bc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:46.893757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3a462-d94c-4b89-b40b-d4f80d772fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:46.894398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3a462-d94c-4b89-b40b-d4f80d772fa4 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:46.894680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3a462-d94c-4b89-b40b-d4f80d772fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:46.894952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3a462-d94c-4b89-b40b-d4f80d772fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:46.903031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3a462-d94c-4b89-b40b-d4f80d772fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:46.904596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3a462-d94c-4b89-b40b-d4f80d772fa4 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:46.914477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 702/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:48.244456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006f2b4-9830-4a7a-8bde-c51bff9d6250 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:48.245059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006f2b4-9830-4a7a-8bde-c51bff9d6250 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:48.245059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006f2b4-9830-4a7a-8bde-c51bff9d6250 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:48.246410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:48.255457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1012c8-d0f2-4325-86a9-5f31daf76710 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:48.255899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1012c8-d0f2-4325-86a9-5f31daf76710 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:48.256118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1012c8-d0f2-4325-86a9-5f31daf76710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:48.274269 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bd1012c8-d0f2-4325-86a9-5f31daf76710 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:48.275464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bd1012c8-d0f2-4325-86a9-5f31daf76710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:48.283710 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:48.434627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006f2b4-9830-4a7a-8bde-c51bff9d6250 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:48.449383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006f2b4-9830-4a7a-8bde-c51bff9d6250 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:48.455349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52928262-e7a3-4bed-9ea8-9af89a3aa54e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:48.455980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928262-e7a3-4bed-9ea8-9af89a3aa54e service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:48.456298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928262-e7a3-4bed-9ea8-9af89a3aa54e service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:48.456572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928262-e7a3-4bed-9ea8-9af89a3aa54e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:48.464731 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52928262-e7a3-4bed-9ea8-9af89a3aa54e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:48.466319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52928262-e7a3-4bed-9ea8-9af89a3aa54e service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:48.476372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 728/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:49.812215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf14c4-336d-4b1f-ae0f-a0cc083c1c40 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:49.812800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf14c4-336d-4b1f-ae0f-a0cc083c1c40 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:49.812800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf14c4-336d-4b1f-ae0f-a0cc083c1c40 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:49.814220 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:49.819066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83630-beb3-401c-882d-148906af273e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:49.819473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83630-beb3-401c-882d-148906af273e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:49.819608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83630-beb3-401c-882d-148906af273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:49.838060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c5f83630-beb3-401c-882d-148906af273e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:49.839236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c5f83630-beb3-401c-882d-148906af273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:49.847815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:50.000914 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf14c4-336d-4b1f-ae0f-a0cc083c1c40 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:50.014807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf14c4-336d-4b1f-ae0f-a0cc083c1c40 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:50.021068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748a555-fa47-4213-87b1-dc716a969edb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:50.021698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748a555-fa47-4213-87b1-dc716a969edb service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:50.021977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748a555-fa47-4213-87b1-dc716a969edb service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:50.022249 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748a555-fa47-4213-87b1-dc716a969edb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:50.030337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748a555-fa47-4213-87b1-dc716a969edb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:50.032682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748a555-fa47-4213-87b1-dc716a969edb service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:50.042092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 705/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:51.341334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e2705-03db-49a6-a562-7f7facc3a297 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:51.341882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e2705-03db-49a6-a562-7f7facc3a297 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:51.341882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e2705-03db-49a6-a562-7f7facc3a297 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:51.343253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:51.348462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465934e3-f853-489a-8869-c00ea05369be None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:51.348868 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465934e3-f853-489a-8869-c00ea05369be None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:51.349042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465934e3-f853-489a-8869-c00ea05369be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:51.367024 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-465934e3-f853-489a-8869-c00ea05369be None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:51.368197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-465934e3-f853-489a-8869-c00ea05369be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:51.375878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:51.527180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e2705-03db-49a6-a562-7f7facc3a297 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:51.541517 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e2705-03db-49a6-a562-7f7facc3a297 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:51.547546 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff47b98-5d9f-449a-9c20-d2c96c8382a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:51.548249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff47b98-5d9f-449a-9c20-d2c96c8382a8 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:51.548530 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff47b98-5d9f-449a-9c20-d2c96c8382a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:51.548803 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff47b98-5d9f-449a-9c20-d2c96c8382a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:51.556875 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff47b98-5d9f-449a-9c20-d2c96c8382a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:51.558470 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff47b98-5d9f-449a-9c20-d2c96c8382a8 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:51.568464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 731/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:52.919223 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19da39-323e-4ebb-83a2-5709b6b6d580 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:52.919742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19da39-323e-4ebb-83a2-5709b6b6d580 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:52.919742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19da39-323e-4ebb-83a2-5709b6b6d580 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:52.921559 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:52.928030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95a51a-9e69-4fcc-90c1-8cc5a1bd3fcf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:52.928481 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95a51a-9e69-4fcc-90c1-8cc5a1bd3fcf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:52.928578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95a51a-9e69-4fcc-90c1-8cc5a1bd3fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:52.946032 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6c95a51a-9e69-4fcc-90c1-8cc5a1bd3fcf None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:52.947215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6c95a51a-9e69-4fcc-90c1-8cc5a1bd3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:52.955726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:18:53.103187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19da39-323e-4ebb-83a2-5709b6b6d580 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:53.117616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19da39-323e-4ebb-83a2-5709b6b6d580 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:53.122823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f4420-0e5b-483d-840b-94f9b37df515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:53.123443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f4420-0e5b-483d-840b-94f9b37df515 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:53.123722 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f4420-0e5b-483d-840b-94f9b37df515 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:53.123993 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f4420-0e5b-483d-840b-94f9b37df515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:53.132497 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f4420-0e5b-483d-840b-94f9b37df515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:53.134082 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f4420-0e5b-483d-840b-94f9b37df515 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:53.143382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 708/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:55.358181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a424b49-9459-461f-9df2-ed5e18934583 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:55.358724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a424b49-9459-461f-9df2-ed5e18934583 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:55.358724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a424b49-9459-461f-9df2-ed5e18934583 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:55.360854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:55.366232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76b4d0-9319-4186-b65a-4d242f3b0dbc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:55.366698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76b4d0-9319-4186-b65a-4d242f3b0dbc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:55.366803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76b4d0-9319-4186-b65a-4d242f3b0dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:55.385323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3a76b4d0-9319-4186-b65a-4d242f3b0dbc None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:55.386510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3a76b4d0-9319-4186-b65a-4d242f3b0dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:55.394410 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:55.434421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a424b49-9459-461f-9df2-ed5e18934583 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:55.446103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a424b49-9459-461f-9df2-ed5e18934583 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:55.449902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ffff1-1d8f-478b-bc65-1addf87babee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:55.450543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ffff1-1d8f-478b-bc65-1addf87babee service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:55.450823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ffff1-1d8f-478b-bc65-1addf87babee service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:55.451098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ffff1-1d8f-478b-bc65-1addf87babee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:55.460108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ffff1-1d8f-478b-bc65-1addf87babee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:55.461587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ffff1-1d8f-478b-bc65-1addf87babee service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:55.471228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 734/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:18:57.938153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a21ad8-3bb5-4b09-834c-e534580951d8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:57.938717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a21ad8-3bb5-4b09-834c-e534580951d8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:57.938717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a21ad8-3bb5-4b09-834c-e534580951d8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:57.940017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:18:57.945456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79530f2b-1daa-4903-8055-0daa007ee21c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:57.945897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79530f2b-1daa-4903-8055-0daa007ee21c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:57.946004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79530f2b-1daa-4903-8055-0daa007ee21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:57.963427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-79530f2b-1daa-4903-8055-0daa007ee21c None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:18:57.964642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-79530f2b-1daa-4903-8055-0daa007ee21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:18:57.972988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:18:58.011736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a21ad8-3bb5-4b09-834c-e534580951d8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:18:58.022444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a21ad8-3bb5-4b09-834c-e534580951d8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:18:58.025979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516b078-fa7a-4d00-9a5c-d460d7862981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:18:58.026610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516b078-fa7a-4d00-9a5c-d460d7862981 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:18:58.026897 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516b078-fa7a-4d00-9a5c-d460d7862981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:18:58.027176 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516b078-fa7a-4d00-9a5c-d460d7862981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:18:58.036689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516b078-fa7a-4d00-9a5c-d460d7862981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:18:58.038152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516b078-fa7a-4d00-9a5c-d460d7862981 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:18:58.047961 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 711/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:19:00.707485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288750dd-3c43-42d5-b6ac-0786fefa2e38 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:00.708026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288750dd-3c43-42d5-b6ac-0786fefa2e38 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:00.708026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288750dd-3c43-42d5-b6ac-0786fefa2e38 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:00.709454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:00.714742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62644f92-118c-40fc-a6db-281c84c6dd3a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:00.715163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62644f92-118c-40fc-a6db-281c84c6dd3a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:00.715265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62644f92-118c-40fc-a6db-281c84c6dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:00.733606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-62644f92-118c-40fc-a6db-281c84c6dd3a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:00.735182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-62644f92-118c-40fc-a6db-281c84c6dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:00.743152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:19:00.783805 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288750dd-3c43-42d5-b6ac-0786fefa2e38 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:19:00.794174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288750dd-3c43-42d5-b6ac-0786fefa2e38 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:19:00.798802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03867187-94d4-4f88-9503-bdced08613a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:19:00.799433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867187-94d4-4f88-9503-bdced08613a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:00.799710 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867187-94d4-4f88-9503-bdced08613a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:00.799984 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867187-94d4-4f88-9503-bdced08613a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:00.809032 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03867187-94d4-4f88-9503-bdced08613a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:19:00.810444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03867187-94d4-4f88-9503-bdced08613a6 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:19:00.820202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 737/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:19:03.259483 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9794f-432f-4ea0-94b0-d18b4ecad7fd None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:03.260052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9794f-432f-4ea0-94b0-d18b4ecad7fd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:03.260052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9794f-432f-4ea0-94b0-d18b4ecad7fd None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:03.261432 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:03.267273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fb06c-6d77-4f60-9281-c9ee9517d13c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:03.267722 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fb06c-6d77-4f60-9281-c9ee9517d13c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:03.267820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fb06c-6d77-4f60-9281-c9ee9517d13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:03.284868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e00fb06c-6d77-4f60-9281-c9ee9517d13c None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:03.286068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e00fb06c-6d77-4f60-9281-c9ee9517d13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:03.293670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:19:03.334534 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9794f-432f-4ea0-94b0-d18b4ecad7fd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:19:03.345027 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9794f-432f-4ea0-94b0-d18b4ecad7fd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:19:03.348496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b6b7e-47ad-4a00-b47a-beb5551b1987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:19:03.349159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b6b7e-47ad-4a00-b47a-beb5551b1987 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:03.349443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b6b7e-47ad-4a00-b47a-beb5551b1987 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:03.349717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b6b7e-47ad-4a00-b47a-beb5551b1987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:03.359020 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b6b7e-47ad-4a00-b47a-beb5551b1987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:19:03.360597 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b6b7e-47ad-4a00-b47a-beb5551b1987 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:19:03.369816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 714/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:19:05.721519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a171-d2eb-4916-8d42-263ee7d9cd30 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:05.722962 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a171-d2eb-4916-8d42-263ee7d9cd30 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:05.723473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a171-d2eb-4916-8d42-263ee7d9cd30 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:05.725397 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:19:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 14:19:05.735328 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ed77b-22f1-48ac-ad2e-8b9377764c5e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:05.735929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ed77b-22f1-48ac-ad2e-8b9377764c5e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:05.735929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ed77b-22f1-48ac-ad2e-8b9377764c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:05.754982 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b37ed77b-22f1-48ac-ad2e-8b9377764c5e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:05.756218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b37ed77b-22f1-48ac-ad2e-8b9377764c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:05.764333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:19:05.805764 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96a171-d2eb-4916-8d42-263ee7d9cd30 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:19:05.817769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96a171-d2eb-4916-8d42-263ee7d9cd30 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:19:05.821438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9af65-106e-4599-ae20-a8ad6cd4c485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:19:05.822092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9af65-106e-4599-ae20-a8ad6cd4c485 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:05.822623 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9af65-106e-4599-ae20-a8ad6cd4c485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:05.822899 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9af65-106e-4599-ae20-a8ad6cd4c485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:05.832455 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9af65-106e-4599-ae20-a8ad6cd4c485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:19:05.833910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9af65-106e-4599-ae20-a8ad6cd4c485 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:19:05.844236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 740/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:19:08.356798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb73236-8f6d-4083-a71e-e6a2614b6c43 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:08.357445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb73236-8f6d-4083-a71e-e6a2614b6c43 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:08.357445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb73236-8f6d-4083-a71e-e6a2614b6c43 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:08.359681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:08.365219 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7667b19-1e49-46b9-8070-e7ce02fee65a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:08.365748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7667b19-1e49-46b9-8070-e7ce02fee65a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:08.365891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7667b19-1e49-46b9-8070-e7ce02fee65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:08.384085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a7667b19-1e49-46b9-8070-e7ce02fee65a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:08.385318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a7667b19-1e49-46b9-8070-e7ce02fee65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:08.393974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:19:08.434158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb73236-8f6d-4083-a71e-e6a2614b6c43 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:19:08.445177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb73236-8f6d-4083-a71e-e6a2614b6c43 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:19:08.449042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a6d7b-bdf5-4af5-a3de-453a1339642e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:19:08.452765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a6d7b-bdf5-4af5-a3de-453a1339642e service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:08.452765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a6d7b-bdf5-4af5-a3de-453a1339642e service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:08.452765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a6d7b-bdf5-4af5-a3de-453a1339642e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:08.461130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a6d7b-bdf5-4af5-a3de-453a1339642e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:19:08.462606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a6d7b-bdf5-4af5-a3de-453a1339642e service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:19:08.472476 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 717/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:19:10.866528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbd60-1a40-4fe5-9862-070b1c670bc6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:10.867109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbd60-1a40-4fe5-9862-070b1c670bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:10.867109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbd60-1a40-4fe5-9862-070b1c670bc6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:10.868454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:10.882008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0f75-86de-4c03-b6af-5b679fa1b293 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:10.882542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0f75-86de-4c03-b6af-5b679fa1b293 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:10.882542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0f75-86de-4c03-b6af-5b679fa1b293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:10.906329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1e3a0f75-86de-4c03-b6af-5b679fa1b293 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:10.907538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1e3a0f75-86de-4c03-b6af-5b679fa1b293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:10.915363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:19:10.954166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cbd60-1a40-4fe5-9862-070b1c670bc6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:19:10.965957 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cbd60-1a40-4fe5-9862-070b1c670bc6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:19:10.970063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075ad5c-4384-4775-9065-81fd9124acaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:19:10.970701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075ad5c-4384-4775-9065-81fd9124acaa service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:10.970980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075ad5c-4384-4775-9065-81fd9124acaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:10.971254 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075ad5c-4384-4775-9065-81fd9124acaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:10.980508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075ad5c-4384-4775-9065-81fd9124acaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:19:10.981962 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075ad5c-4384-4775-9065-81fd9124acaa service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:19:10.991501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 743/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:19:13.385865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce7c67-0587-4e2c-82aa-99cde10f829a None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:13.386433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce7c67-0587-4e2c-82aa-99cde10f829a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:13.386433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce7c67-0587-4e2c-82aa-99cde10f829a None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:13.387849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:13.394469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166bea9-656d-4780-96a9-a92b883eb7a3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:13.394914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166bea9-656d-4780-96a9-a92b883eb7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:13.395016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166bea9-656d-4780-96a9-a92b883eb7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:13.412545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1166bea9-656d-4780-96a9-a92b883eb7a3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:13.413761 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1166bea9-656d-4780-96a9-a92b883eb7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:13.422924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:19:13.462327 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce7c67-0587-4e2c-82aa-99cde10f829a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:19:13.474798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce7c67-0587-4e2c-82aa-99cde10f829a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:19:13.478304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419ddfc-ae37-4362-9c3f-0a81601a8524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:19:13.478994 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419ddfc-ae37-4362-9c3f-0a81601a8524 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:13.479276 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419ddfc-ae37-4362-9c3f-0a81601a8524 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:13.479585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419ddfc-ae37-4362-9c3f-0a81601a8524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:13.490223 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419ddfc-ae37-4362-9c3f-0a81601a8524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:19:13.491638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419ddfc-ae37-4362-9c3f-0a81601a8524 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:19:13.501682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 720/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:19:15.865867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7ba0d-b1b6-482b-bcc3-5cb19c33c5b9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:15.865867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7ba0d-b1b6-482b-bcc3-5cb19c33c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:15.865867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7ba0d-b1b6-482b-bcc3-5cb19c33c5b9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:15.868097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:15.873750 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45835ad8-455b-444d-99e5-6e47b9c75390 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:15.874188 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45835ad8-455b-444d-99e5-6e47b9c75390 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:15.874336 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45835ad8-455b-444d-99e5-6e47b9c75390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:15.893658 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-45835ad8-455b-444d-99e5-6e47b9c75390 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:15.894881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-45835ad8-455b-444d-99e5-6e47b9c75390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:15.905219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:19:15.944242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7ba0d-b1b6-482b-bcc3-5cb19c33c5b9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:19:15.955880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7ba0d-b1b6-482b-bcc3-5cb19c33c5b9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:19:15.959349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abe25f-a8cd-490d-a8e8-895953b11189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:19:15.961055 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abe25f-a8cd-490d-a8e8-895953b11189 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:15.961055 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abe25f-a8cd-490d-a8e8-895953b11189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:15.961055 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abe25f-a8cd-490d-a8e8-895953b11189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:15.973308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abe25f-a8cd-490d-a8e8-895953b11189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:19:15.974720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abe25f-a8cd-490d-a8e8-895953b11189 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:19:15.985473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 746/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:19:18.308067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc4841-14fd-4075-b7ed-31515470f0fc None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:18.308659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc4841-14fd-4075-b7ed-31515470f0fc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:18.308659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc4841-14fd-4075-b7ed-31515470f0fc None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:18.310027 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:18.315951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a054635-cc32-4b84-8b1e-9eadc39575e4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:18.316357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a054635-cc32-4b84-8b1e-9eadc39575e4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:18.316505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a054635-cc32-4b84-8b1e-9eadc39575e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:18.334555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5a054635-cc32-4b84-8b1e-9eadc39575e4 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:18.335735 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5a054635-cc32-4b84-8b1e-9eadc39575e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:18.343453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:19:18.381061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc4841-14fd-4075-b7ed-31515470f0fc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:19:18.392686 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc4841-14fd-4075-b7ed-31515470f0fc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:19:18.401867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b15bea-5e6d-49ee-ba76-d37c22f14972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:19:18.401867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b15bea-5e6d-49ee-ba76-d37c22f14972 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:18.401867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b15bea-5e6d-49ee-ba76-d37c22f14972 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:18.401867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b15bea-5e6d-49ee-ba76-d37c22f14972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:18.407650 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b15bea-5e6d-49ee-ba76-d37c22f14972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:19:18.409117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b15bea-5e6d-49ee-ba76-d37c22f14972 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:19:18.418602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 723/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:19:52.326982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99149-fe83-4fa1-bbf0-55d877aa9b43 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:52.327589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99149-fe83-4fa1-bbf0-55d877aa9b43 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:52.327589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99149-fe83-4fa1-bbf0-55d877aa9b43 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:52.328942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 748/1471] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:52.334993 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844d27c-eb78-489a-ae79-59f0e81b03fe None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:52.335471 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844d27c-eb78-489a-ae79-59f0e81b03fe None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:52.335589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844d27c-eb78-489a-ae79-59f0e81b03fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:52.354067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6844d27c-eb78-489a-ae79-59f0e81b03fe None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:52.355449 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6844d27c-eb78-489a-ae79-59f0e81b03fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:52.365144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 724/1472] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:19:52.412298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad212580-b652-4a96-9f87-85b8a8b9424f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:52.412587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad212580-b652-4a96-9f87-85b8a8b9424f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:52.412873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad212580-b652-4a96-9f87-85b8a8b9424f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:52.414281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 749/1473] 10.222.0.61 () {54 vars in 961 bytes} [Tue Apr 12 14:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:52.419718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00d170-628d-4e80-bde1-ec2f2e5feb64 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:52.420004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00d170-628d-4e80-bde1-ec2f2e5feb64 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:52.420280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00d170-628d-4e80-bde1-ec2f2e5feb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:52.439020 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3d00d170-628d-4e80-bde1-ec2f2e5feb64 None None] MFA Rules not processed for user `21ef8bbd229c488d97f167c810bc7cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:52.440205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3d00d170-628d-4e80-bde1-ec2f2e5feb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:52.446984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 725/1474] 10.222.0.61 () {58 vars in 1058 bytes} [Tue Apr 12 14:19:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:19:52.454752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad212580-b652-4a96-9f87-85b8a8b9424f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:19:52.465930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad212580-b652-4a96-9f87-85b8a8b9424f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:19:52.469680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543cd84-43e8-4270-8bd4-f75785d9092c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef8bbd229c488d97f167c810bc7cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:19:52.470352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543cd84-43e8-4270-8bd4-f75785d9092c service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:52.470640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543cd84-43e8-4270-8bd4-f75785d9092c service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:52.470922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543cd84-43e8-4270-8bd4-f75785d9092c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:52.479657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543cd84-43e8-4270-8bd4-f75785d9092c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:19:52.481905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543cd84-43e8-4270-8bd4-f75785d9092c service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:19:52.491262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 750/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:19:54.917428 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf295d1a-c79f-4a21-90cb-9602b75149d5 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:54.917957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf295d1a-c79f-4a21-90cb-9602b75149d5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:54.917957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf295d1a-c79f-4a21-90cb-9602b75149d5 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:54.919284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 726/1476] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:54.924638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9279bb-8788-4321-8a57-143db886c18c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:54.925095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9279bb-8788-4321-8a57-143db886c18c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:54.925286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9279bb-8788-4321-8a57-143db886c18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:54.942900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6c9279bb-8788-4321-8a57-143db886c18c None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:54.944087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6c9279bb-8788-4321-8a57-143db886c18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:54.952669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 751/1477] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:19:54.975789 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf295d1a-c79f-4a21-90cb-9602b75149d5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:19:54.988267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf295d1a-c79f-4a21-90cb-9602b75149d5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:19:54.992772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c84522-b92b-487a-8b56-8527eda9f8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:19:54.993446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c84522-b92b-487a-8b56-8527eda9f8ac admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:54.993753 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c84522-b92b-487a-8b56-8527eda9f8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:54.994087 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c84522-b92b-487a-8b56-8527eda9f8ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:54.994758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c84522-b92b-487a-8b56-8527eda9f8ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:19:54.997124 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-05c84522-b92b-487a-8b56-8527eda9f8ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:19:54.997124 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Apr 12 14:19:54.997124 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: Apr 12 14:19:54.998248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c84522-b92b-487a-8b56-8527eda9f8ac admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:19:55.018290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 727/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Apr 12 14:19:54 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:19:57.359922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f33ab-5a0b-4360-a7f0-eb73d2fc0c9f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:57.360482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f33ab-5a0b-4360-a7f0-eb73d2fc0c9f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:57.360482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f33ab-5a0b-4360-a7f0-eb73d2fc0c9f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:57.361916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 752/1479] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:57.367297 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560af67-c301-427f-abaf-3caf0363d311 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:57.367704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560af67-c301-427f-abaf-3caf0363d311 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:57.367858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560af67-c301-427f-abaf-3caf0363d311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:57.387329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d560af67-c301-427f-abaf-3caf0363d311 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:57.388615 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d560af67-c301-427f-abaf-3caf0363d311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:57.396587 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 728/1480] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:19:57.439643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f33ab-5a0b-4360-a7f0-eb73d2fc0c9f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:19:57.454120 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f33ab-5a0b-4360-a7f0-eb73d2fc0c9f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:19:57.459472 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db063e3-c530-4fdc-92da-5a2e9dfb81b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:19:57.460107 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db063e3-c530-4fdc-92da-5a2e9dfb81b6 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:57.460387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db063e3-c530-4fdc-92da-5a2e9dfb81b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:57.460661 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db063e3-c530-4fdc-92da-5a2e9dfb81b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:57.468694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db063e3-c530-4fdc-92da-5a2e9dfb81b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:19:57.470368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db063e3-c530-4fdc-92da-5a2e9dfb81b6 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:19:57.479485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 753/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:19:59.962529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b8de3-73f2-465f-8a94-ea6916b70555 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:59.963092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b8de3-73f2-465f-8a94-ea6916b70555 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:59.963092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b8de3-73f2-465f-8a94-ea6916b70555 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:59.964334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 729/1482] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:19:59.970736 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a50a50-3745-437b-ade5-f423fb1ee16b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:19:59.971206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a50a50-3745-437b-ade5-f423fb1ee16b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:19:59.971307 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a50a50-3745-437b-ade5-f423fb1ee16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:19:59.989482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d3a50a50-3745-437b-ade5-f423fb1ee16b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:19:59.990668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d3a50a50-3745-437b-ade5-f423fb1ee16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:19:59.998653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 754/1483] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:20:00.040901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b8de3-73f2-465f-8a94-ea6916b70555 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:20:00.052203 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b8de3-73f2-465f-8a94-ea6916b70555 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:20:00.055712 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54248f-5b65-4497-af4c-204985261e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:20:00.056342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54248f-5b65-4497-af4c-204985261e62 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:20:00.056624 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54248f-5b65-4497-af4c-204985261e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:20:00.056900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54248f-5b65-4497-af4c-204985261e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:20:00.065971 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54248f-5b65-4497-af4c-204985261e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:20:00.067386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54248f-5b65-4497-af4c-204985261e62 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:20:00.077040 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 730/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:20:02.443997 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633d82-de3c-4b9d-8080-b79700c46fb8 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:20:02.444650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633d82-de3c-4b9d-8080-b79700c46fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:20:02.444650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633d82-de3c-4b9d-8080-b79700c46fb8 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:20:02.445947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 755/1485] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:20:02.452171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46e973-63fa-4661-813d-02ed5515d4a2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:20:02.452617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46e973-63fa-4661-813d-02ed5515d4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:20:02.452742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46e973-63fa-4661-813d-02ed5515d4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:20:02.470054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5c46e973-63fa-4661-813d-02ed5515d4a2 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:20:02.471225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5c46e973-63fa-4661-813d-02ed5515d4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:20:02.478829 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 731/1486] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:20:02.517058 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633d82-de3c-4b9d-8080-b79700c46fb8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:20:02.527627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633d82-de3c-4b9d-8080-b79700c46fb8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:20:02.531143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220ccda-a81b-4ecf-b6fc-e12ea794e73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:20:02.531775 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220ccda-a81b-4ecf-b6fc-e12ea794e73a service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:20:02.532077 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220ccda-a81b-4ecf-b6fc-e12ea794e73a service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:20:02.532361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220ccda-a81b-4ecf-b6fc-e12ea794e73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:20:02.541208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220ccda-a81b-4ecf-b6fc-e12ea794e73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:20:02.542706 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220ccda-a81b-4ecf-b6fc-e12ea794e73a service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:20:02.552203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 756/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:20:04.973349 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd7e41-5c71-403c-adcb-0082f0f6accb None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:20:04.973907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd7e41-5c71-403c-adcb-0082f0f6accb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:20:04.973907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd7e41-5c71-403c-adcb-0082f0f6accb None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:20:04.975180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 732/1488] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:20:04.981081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af3a1-3330-403a-a6dd-f53b1bf32edc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:20:04.981732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af3a1-3330-403a-a6dd-f53b1bf32edc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:20:04.981732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af3a1-3330-403a-a6dd-f53b1bf32edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:20:04.999272 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-420af3a1-3330-403a-a6dd-f53b1bf32edc None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:20:05.000445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-420af3a1-3330-403a-a6dd-f53b1bf32edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:20:05.008287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 757/1489] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:20:05.048043 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd7e41-5c71-403c-adcb-0082f0f6accb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:20:05.059337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd7e41-5c71-403c-adcb-0082f0f6accb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:20:05.062858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c32c4a-df6c-4ab6-92e8-9738916d38c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:20:05.063488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32c4a-df6c-4ab6-92e8-9738916d38c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:20:05.063766 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32c4a-df6c-4ab6-92e8-9738916d38c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:20:05.064037 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32c4a-df6c-4ab6-92e8-9738916d38c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:20:05.073252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32c4a-df6c-4ab6-92e8-9738916d38c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:20:05.074665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32c4a-df6c-4ab6-92e8-9738916d38c1 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:20:05.084418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 733/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:20:07.935080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e773bf9-242f-455a-81bd-48751bea080f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:20:07.935640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e773bf9-242f-455a-81bd-48751bea080f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:20:07.935640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e773bf9-242f-455a-81bd-48751bea080f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:20:07.936921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 758/1491] 10.222.0.61 () {54 vars in 926 bytes} [Tue Apr 12 14:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:20:07.942199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a59769-ff0e-470b-816d-ef51d22d03b4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:20:07.942648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a59769-ff0e-470b-816d-ef51d22d03b4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:20:07.942795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a59769-ff0e-470b-816d-ef51d22d03b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:20:07.961311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-74a59769-ff0e-470b-816d-ef51d22d03b4 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:20:07.962513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-74a59769-ff0e-470b-816d-ef51d22d03b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:20:07.970689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 734/1492] 10.222.0.61 () {58 vars in 1023 bytes} [Tue Apr 12 14:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:20:08.009211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e773bf9-242f-455a-81bd-48751bea080f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:20:08.019915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e773bf9-242f-455a-81bd-48751bea080f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:20:08.023429 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336543f-d16e-4bba-ab8d-f4e6b607dd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:20:08.024054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336543f-d16e-4bba-ab8d-f4e6b607dd7b service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:20:08.024334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336543f-d16e-4bba-ab8d-f4e6b607dd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:20:08.024610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336543f-d16e-4bba-ab8d-f4e6b607dd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:20:08.033421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336543f-d16e-4bba-ab8d-f4e6b607dd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:20:08.034833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336543f-d16e-4bba-ab8d-f4e6b607dd7b service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:20:08.044529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 759/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:21:48.971766 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7633bf-dafe-4062-8565-3b3c0d8b6e77 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:48.972413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7633bf-dafe-4062-8565-3b3c0d8b6e77 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:48.972413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7633bf-dafe-4062-8565-3b3c0d8b6e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:48.992483 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8e7633bf-dafe-4062-8565-3b3c0d8b6e77 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:21:48.993731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8e7633bf-dafe-4062-8565-3b3c0d8b6e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:21:49.001887 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 735/1494] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:21:49.010664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6674bc8-c99e-4451-942e-5c7abe9114ea None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:49.011167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6674bc8-c99e-4451-942e-5c7abe9114ea None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:49.011275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6674bc8-c99e-4451-942e-5c7abe9114ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:49.029847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e6674bc8-c99e-4451-942e-5c7abe9114ea None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:21:49.031053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e6674bc8-c99e-4451-942e-5c7abe9114ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:21:49.039685 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 760/1495] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:21:49.044567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7633bf-dafe-4062-8565-3b3c0d8b6e77 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:21:49.055113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7633bf-dafe-4062-8565-3b3c0d8b6e77 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:21:49.059840 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911e5c8-232c-4139-96ab-094dee385075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:21:49.060510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911e5c8-232c-4139-96ab-094dee385075 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:49.060850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911e5c8-232c-4139-96ab-094dee385075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:49.061167 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911e5c8-232c-4139-96ab-094dee385075 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:49.062172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911e5c8-232c-4139-96ab-094dee385075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:21:49.062545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911e5c8-232c-4139-96ab-094dee385075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:21:49.063780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-a911e5c8-232c-4139-96ab-094dee385075 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:21:49.063780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Apr 12 14:21:49.063780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: Apr 12 14:21:49.064945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911e5c8-232c-4139-96ab-094dee385075 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:21:49.080677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 736/1496] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:21:49.089042 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6674bc8-c99e-4451-942e-5c7abe9114ea None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:21:49.100150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6674bc8-c99e-4451-942e-5c7abe9114ea None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:21:49.106600 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea47de-36be-4280-9608-7526b9b18b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:21:49.107459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea47de-36be-4280-9608-7526b9b18b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:49.107866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea47de-36be-4280-9608-7526b9b18b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:49.108300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea47de-36be-4280-9608-7526b9b18b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:49.109092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea47de-36be-4280-9608-7526b9b18b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:21:49.110906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-80ea47de-36be-4280-9608-7526b9b18b17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:21:49.110906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Apr 12 14:21:49.110906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: Apr 12 14:21:49.112193 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea47de-36be-4280-9608-7526b9b18b17 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:21:49.217054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 761/1497] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:21:49 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:21:49.221282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911e5c8-232c-4139-96ab-094dee385075 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:21:49.232490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911e5c8-232c-4139-96ab-094dee385075 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:21:49.292310 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061cbf0-b978-4509-9cb2-0d7f87305e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:21:49.292998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061cbf0-b978-4509-9cb2-0d7f87305e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:49.293280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061cbf0-b978-4509-9cb2-0d7f87305e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:49.293553 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061cbf0-b978-4509-9cb2-0d7f87305e00 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:49.295121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061cbf0-b978-4509-9cb2-0d7f87305e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:21:49.296143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-7061cbf0-b978-4509-9cb2-0d7f87305e00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:21:49.296143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Apr 12 14:21:49.296143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: Apr 12 14:21:49.298151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061cbf0-b978-4509-9cb2-0d7f87305e00 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:21:49.375055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 737/1498] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:21:49 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:21:49.379224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea47de-36be-4280-9608-7526b9b18b17 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:21:49.389860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea47de-36be-4280-9608-7526b9b18b17 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:21:49.394536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7cf19-1169-42e5-8c36-490d7fa9f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:21:49.395268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7cf19-1169-42e5-8c36-490d7fa9f396 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:49.396083 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7cf19-1169-42e5-8c36-490d7fa9f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:49.396539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7cf19-1169-42e5-8c36-490d7fa9f396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:49.397321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7cf19-1169-42e5-8c36-490d7fa9f396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:21:49.398380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-25d7cf19-1169-42e5-8c36-490d7fa9f396 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:21:49.398380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Apr 12 14:21:49.398380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: Apr 12 14:21:49.399319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7cf19-1169-42e5-8c36-490d7fa9f396 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:21:49.413613 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 762/1499] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:21:49.417561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061cbf0-b978-4509-9cb2-0d7f87305e00 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:21:49.428090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061cbf0-b978-4509-9cb2-0d7f87305e00 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:21:49.432816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525d30a-0426-4e89-8970-acf46b1197f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:21:49.433505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525d30a-0426-4e89-8970-acf46b1197f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:49.433782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525d30a-0426-4e89-8970-acf46b1197f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:49.434050 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525d30a-0426-4e89-8970-acf46b1197f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:49.434858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525d30a-0426-4e89-8970-acf46b1197f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:21:49.435909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-c525d30a-0426-4e89-8970-acf46b1197f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:21:49.435909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Apr 12 14:21:49.435909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: Apr 12 14:21:49.436783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525d30a-0426-4e89-8970-acf46b1197f1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:21:49.450669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 738/1500] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:21:49.455120 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7cf19-1169-42e5-8c36-490d7fa9f396 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:21:49.465688 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7cf19-1169-42e5-8c36-490d7fa9f396 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:21:49.470201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a458038-9d6e-46a3-a5b6-8c119950d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:21:49.471080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a458038-9d6e-46a3-a5b6-8c119950d4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:49.471364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a458038-9d6e-46a3-a5b6-8c119950d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:49.471643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a458038-9d6e-46a3-a5b6-8c119950d4ef admin admin] PATH_INFO: `/v3/projects/ed3cb94a5cad47e39b1745829c255c7e/users/1c5f77427f66476da1e314092b3bf304/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:49.486634 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a458038-9d6e-46a3-a5b6-8c119950d4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3cb94a5cad47e39b1745829c255c7e, user_id=1c5f77427f66476da1e314092b3bf304, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:21:49.487659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-1a458038-9d6e-46a3-a5b6-8c119950d4ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:21:49.487659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Apr 12 14:21:49.487659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: Apr 12 14:21:49.489701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a458038-9d6e-46a3-a5b6-8c119950d4ef admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:21:49.605104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 763/1501] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:21:49 2022] PUT /identity/v3/projects/ed3cb94a5cad47e39b1745829c255c7e/users/1c5f77427f66476da1e314092b3bf304/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:21:49.619185 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aae8f3-3685-4b06-8b90-435512e650dc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:49.619479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aae8f3-3685-4b06-8b90-435512e650dc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:49.619791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aae8f3-3685-4b06-8b90-435512e650dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:49.647041 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b0aae8f3-3685-4b06-8b90-435512e650dc None None] MFA Rules not processed for user `1c5f77427f66476da1e314092b3bf304`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:21:49.648761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b0aae8f3-3685-4b06-8b90-435512e650dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:21:49.714537 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 739/1502] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:21:49.726529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a458038-9d6e-46a3-a5b6-8c119950d4ef admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:21:49.796088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a458038-9d6e-46a3-a5b6-8c119950d4ef admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:21:49.801524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68ba7a-2612-487b-a7ac-ceb5fa378857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:21:49.802202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68ba7a-2612-487b-a7ac-ceb5fa378857 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:49.802668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68ba7a-2612-487b-a7ac-ceb5fa378857 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:49.802963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68ba7a-2612-487b-a7ac-ceb5fa378857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:49.811225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68ba7a-2612-487b-a7ac-ceb5fa378857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:21:49.812801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68ba7a-2612-487b-a7ac-ceb5fa378857 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:21:49.822595 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 764/1503] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:21:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:21:49.910788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040dd05-3c9b-4acf-bed9-4393e2698084 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:49.911156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040dd05-3c9b-4acf-bed9-4393e2698084 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:49.911474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040dd05-3c9b-4acf-bed9-4393e2698084 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:49.912761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 740/1504] 10.222.0.61 () {52 vars in 829 bytes} [Tue Apr 12 14:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:21:49.916610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68ba7a-2612-487b-a7ac-ceb5fa378857 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:21:49.980292 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68ba7a-2612-487b-a7ac-ceb5fa378857 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:21:49.985036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:21:49.986032 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:49.986328 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:49.986606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] PATH_INFO: `/v3/users/1c5f77427f66476da1e314092b3bf304` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:49.987863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5f77427f66476da1e314092b3bf304)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:21:49.990246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:21:49.990246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Apr 12 14:21:49.990246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: Apr 12 14:21:49.991601 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:21:50.214923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5f77427f66476da1e314092b3bf304'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:21:50.233157 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5f77427f66476da1e314092b3bf304'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:21:50.300268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5f77427f66476da1e314092b3bf304'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:21:50.315569 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5f77427f66476da1e314092b3bf304'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:21:50.316359 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5f77427f66476da1e314092b3bf304'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:21:50.322836 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 765/1505] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:21:49 2022] DELETE /identity/v3/users/1c5f77427f66476da1e314092b3bf304 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:21:50.327501 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc587-9530-4f28-81a0-14b55d319c42 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:50.327960 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc587-9530-4f28-81a0-14b55d319c42 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:50.328218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc587-9530-4f28-81a0-14b55d319c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:50.347269 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-683fc587-9530-4f28-81a0-14b55d319c42 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:21:50.349315 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-683fc587-9530-4f28-81a0-14b55d319c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:21:50.415801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 741/1506] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:21:50.427352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:21:50.428801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:21:50.494999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56562c-156e-4783-9397-0d08d2b739e2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:21:50.498491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f713526-7b7f-427d-b11a-1412bb49aadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:21:50.499137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713526-7b7f-427d-b11a-1412bb49aadf service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:50.499419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713526-7b7f-427d-b11a-1412bb49aadf service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:50.499693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713526-7b7f-427d-b11a-1412bb49aadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:50.508564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f713526-7b7f-427d-b11a-1412bb49aadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:21:50.510024 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f713526-7b7f-427d-b11a-1412bb49aadf service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:21:50.519316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 766/1507] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:21:51.034947 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fc587-9530-4f28-81a0-14b55d319c42 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:21:51.036913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-683fc587-9530-4f28-81a0-14b55d319c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:21:51.048902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fc587-9530-4f28-81a0-14b55d319c42 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:21:51.054802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:21:51.055668 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:21:51.055955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:21:51.056230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] PATH_INFO: `/v3/projects/ed3cb94a5cad47e39b1745829c255c7e` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:21:51.057473 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3cb94a5cad47e39b1745829c255c7e)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:21:51.058546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:21:51.058546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Apr 12 14:21:51.058546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: Apr 12 14:21:51.059823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:21:51.192130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3cb94a5cad47e39b1745829c255c7e', 'request_id': 'req-5a759b28-2a06-467a-9517-f6a1d517565f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:21:51.283000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3cb94a5cad47e39b1745829c255c7e', 'request_id': 'req-5a759b28-2a06-467a-9517-f6a1d517565f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:21:51.297809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3cb94a5cad47e39b1745829c255c7e', 'request_id': 'req-5a759b28-2a06-467a-9517-f6a1d517565f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:21:51.309268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] The token cache is being invalidate because project ed3cb94a5cad47e39b1745829c255c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:21:51.309558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:21:51.310203 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5a759b28-2a06-467a-9517-f6a1d517565f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:21:51.311872 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 742/1508] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:21:51 2022] DELETE /identity/v3/projects/ed3cb94a5cad47e39b1745829c255c7e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:23:34.550723 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb37942-9e60-441c-8767-6251bda03746 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:34.551368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb37942-9e60-441c-8767-6251bda03746 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:34.551472 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb37942-9e60-441c-8767-6251bda03746 None None] PATH_INFO: `/v3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:34.553146 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 767/1509] 10.222.0.48 () {54 vars in 925 bytes} [Tue Apr 12 14:23:34 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:23:34.559047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705407-f6d7-4b8f-981f-86b665b8d4f3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:34.559580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705407-f6d7-4b8f-981f-86b665b8d4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:34.559580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705407-f6d7-4b8f-981f-86b665b8d4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:34.578604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ea705407-f6d7-4b8f-981f-86b665b8d4f3 None None] MFA Rules not processed for user `3a7095f3ab8545c589d4d28a846ba1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:23:34.579832 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ea705407-f6d7-4b8f-981f-86b665b8d4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:23:34.643568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 743/1510] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Apr 12 14:23:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:23:34.674063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192c1c6-e40a-4e77-8117-4e6d03b57d50 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:34.674358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192c1c6-e40a-4e77-8117-4e6d03b57d50 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:34.674657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192c1c6-e40a-4e77-8117-4e6d03b57d50 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:34.676052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:23:34.681723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28851b-6718-4c44-a8a8-767ae18cbd15 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:34.682009 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28851b-6718-4c44-a8a8-767ae18cbd15 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:34.682281 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28851b-6718-4c44-a8a8-767ae18cbd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:34.700807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fb28851b-6718-4c44-a8a8-767ae18cbd15 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:23:34.702045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fb28851b-6718-4c44-a8a8-767ae18cbd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:23:34.759440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:23:34.912639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192c1c6-e40a-4e77-8117-4e6d03b57d50 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:23:34.914360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d192c1c6-e40a-4e77-8117-4e6d03b57d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:23:34.989006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192c1c6-e40a-4e77-8117-4e6d03b57d50 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:23:34.994441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75834dd9-6cf5-4944-a4d2-530576211b83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:23:34.995089 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75834dd9-6cf5-4944-a4d2-530576211b83 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:34.995374 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75834dd9-6cf5-4944-a4d2-530576211b83 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:34.995663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75834dd9-6cf5-4944-a4d2-530576211b83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:35.003745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75834dd9-6cf5-4944-a4d2-530576211b83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:23:35.005853 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75834dd9-6cf5-4944-a4d2-530576211b83 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:23:35.015283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 769/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:23:36.319967 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3afae7-c0b3-4aee-aa2a-969902d0a125 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:36.320557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3afae7-c0b3-4aee-aa2a-969902d0a125 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:36.320557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3afae7-c0b3-4aee-aa2a-969902d0a125 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:36.321904 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 745/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:23:36.327019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12eda4-5ac1-4a82-94be-7a34dc551120 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:36.327469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12eda4-5ac1-4a82-94be-7a34dc551120 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:36.327629 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12eda4-5ac1-4a82-94be-7a34dc551120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:36.345618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-dc12eda4-5ac1-4a82-94be-7a34dc551120 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:23:36.346815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dc12eda4-5ac1-4a82-94be-7a34dc551120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:23:36.355450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 770/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:23:36.510932 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3afae7-c0b3-4aee-aa2a-969902d0a125 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:23:36.524997 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3afae7-c0b3-4aee-aa2a-969902d0a125 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:23:36.530607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4674f23-24f8-482e-ab2d-920edf04e6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:23:36.531238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674f23-24f8-482e-ab2d-920edf04e6b2 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:36.531521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674f23-24f8-482e-ab2d-920edf04e6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:36.531798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674f23-24f8-482e-ab2d-920edf04e6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:36.540374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4674f23-24f8-482e-ab2d-920edf04e6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:23:36.541988 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4674f23-24f8-482e-ab2d-920edf04e6b2 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:23:36.551706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 746/1516] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:23:38.866453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cd6bc-6c2b-4737-994e-a97a1c554720 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:38.867010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cd6bc-6c2b-4737-994e-a97a1c554720 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:38.867010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cd6bc-6c2b-4737-994e-a97a1c554720 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:38.868366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 771/1517] 10.222.0.61 () {54 vars in 960 bytes} [Tue Apr 12 14:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:23:38.873473 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1150f-37a0-4692-bfa8-b79cb638e8f8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:38.873969 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1150f-37a0-4692-bfa8-b79cb638e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:38.874156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1150f-37a0-4692-bfa8-b79cb638e8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:38.892647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6ad1150f-37a0-4692-bfa8-b79cb638e8f8 None None] MFA Rules not processed for user `3a7095f3ab8545c589d4d28a846ba1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:23:38.893869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6ad1150f-37a0-4692-bfa8-b79cb638e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:23:38.903168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 747/1518] 10.222.0.61 () {58 vars in 1057 bytes} [Tue Apr 12 14:23:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:23:38.910734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cd6bc-6c2b-4737-994e-a97a1c554720 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:23:38.923727 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cd6bc-6c2b-4737-994e-a97a1c554720 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:23:38.930737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89acfc-002a-47f9-8898-5a07591a5c8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7095f3ab8545c589d4d28a846ba1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:23:38.931386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89acfc-002a-47f9-8898-5a07591a5c8c service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:38.931667 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89acfc-002a-47f9-8898-5a07591a5c8c service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:38.931942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89acfc-002a-47f9-8898-5a07591a5c8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:38.941483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89acfc-002a-47f9-8898-5a07591a5c8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:23:38.943771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89acfc-002a-47f9-8898-5a07591a5c8c service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:23:38.955551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 772/1519] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:23:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:23:48.259684 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3aa9-c6b9-4c1d-b55d-8a07b63f9a9c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:48.260265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3aa9-c6b9-4c1d-b55d-8a07b63f9a9c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:48.260265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3aa9-c6b9-4c1d-b55d-8a07b63f9a9c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:48.261670 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 748/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:23:48.266614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01c8b-ece6-4b64-bddb-c12a82a87170 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:48.267039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01c8b-ece6-4b64-bddb-c12a82a87170 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:48.267174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01c8b-ece6-4b64-bddb-c12a82a87170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:48.285548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-00b01c8b-ece6-4b64-bddb-c12a82a87170 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:23:48.286830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-00b01c8b-ece6-4b64-bddb-c12a82a87170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:23:48.294552 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 773/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:23:48.447182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d3aa9-c6b9-4c1d-b55d-8a07b63f9a9c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:23:48.461866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d3aa9-c6b9-4c1d-b55d-8a07b63f9a9c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:23:48.467269 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6e43e-4d6c-420b-825e-ce460ce8aaac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:23:48.467895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6e43e-4d6c-420b-825e-ce460ce8aaac service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:48.468170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6e43e-4d6c-420b-825e-ce460ce8aaac service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:48.468439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6e43e-4d6c-420b-825e-ce460ce8aaac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:48.476599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6e43e-4d6c-420b-825e-ce460ce8aaac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:23:48.478271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6e43e-4d6c-420b-825e-ce460ce8aaac service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:23:48.487326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 749/1522] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:23:49.785466 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b7840-ede2-40ff-9e59-f76dfed28661 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:49.786024 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b7840-ede2-40ff-9e59-f76dfed28661 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:49.786024 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b7840-ede2-40ff-9e59-f76dfed28661 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:49.787430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 774/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 14:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:23:49.792718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661da2c3-61d0-4385-b6e6-ac62c919d02e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:49.793492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661da2c3-61d0-4385-b6e6-ac62c919d02e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:49.793492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661da2c3-61d0-4385-b6e6-ac62c919d02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:49.811696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-661da2c3-61d0-4385-b6e6-ac62c919d02e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:23:49.812888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-661da2c3-61d0-4385-b6e6-ac62c919d02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:23:49.820939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 750/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 14:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:23:49.975833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b7840-ede2-40ff-9e59-f76dfed28661 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:23:49.992679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b7840-ede2-40ff-9e59-f76dfed28661 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:23:49.998130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951da6-e1c8-47df-af7e-b570471f3e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:23:49.998776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951da6-e1c8-47df-af7e-b570471f3e38 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:49.999085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951da6-e1c8-47df-af7e-b570471f3e38 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:49.999363 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951da6-e1c8-47df-af7e-b570471f3e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:50.007968 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf951da6-e1c8-47df-af7e-b570471f3e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:23:50.009578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf951da6-e1c8-47df-af7e-b570471f3e38 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:23:50.019172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 775/1525] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:23:54.409425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7faf6-fd09-4795-a248-9bbcd0d99d06 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:54.410034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7faf6-fd09-4795-a248-9bbcd0d99d06 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:54.410034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7faf6-fd09-4795-a248-9bbcd0d99d06 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:54.411441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 751/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:23:54.416858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aead2-08f0-4135-b61e-f4299f1f813f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:54.417345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aead2-08f0-4135-b61e-f4299f1f813f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:54.417443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aead2-08f0-4135-b61e-f4299f1f813f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:54.435409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a54aead2-08f0-4135-b61e-f4299f1f813f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:23:54.436608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a54aead2-08f0-4135-b61e-f4299f1f813f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:23:54.445919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 776/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:23:54.481802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7faf6-fd09-4795-a248-9bbcd0d99d06 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:23:54.483614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dcc7faf6-fd09-4795-a248-9bbcd0d99d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:23:54.543492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7faf6-fd09-4795-a248-9bbcd0d99d06 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:23:54.548285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4d106-7a9c-466f-982b-d99d68ccb0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:23:54.548945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4d106-7a9c-466f-982b-d99d68ccb0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:54.549255 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4d106-7a9c-466f-982b-d99d68ccb0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:54.549529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4d106-7a9c-466f-982b-d99d68ccb0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:54.559132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4d106-7a9c-466f-982b-d99d68ccb0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:23:54.560574 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4d106-7a9c-466f-982b-d99d68ccb0d6 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:23:54.570884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 752/1528] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:23:56.892700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8f8c-88ce-48c6-992b-b1509ec6ec57 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:56.893840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8f8c-88ce-48c6-992b-b1509ec6ec57 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:56.893840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8f8c-88ce-48c6-992b-b1509ec6ec57 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:56.895639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 777/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:23:56.900707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72a523-1072-4340-bc69-3e5fa9a1b66d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:56.901143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72a523-1072-4340-bc69-3e5fa9a1b66d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:56.901290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72a523-1072-4340-bc69-3e5fa9a1b66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:56.919882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ec72a523-1072-4340-bc69-3e5fa9a1b66d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:23:56.921012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ec72a523-1072-4340-bc69-3e5fa9a1b66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:23:56.929072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 753/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:23:56.964324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f8f8c-88ce-48c6-992b-b1509ec6ec57 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:23:56.976538 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f8f8c-88ce-48c6-992b-b1509ec6ec57 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:23:56.979995 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94f39b-ccfa-496d-b79e-d9c083e126f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:23:56.980626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94f39b-ccfa-496d-b79e-d9c083e126f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:23:56.980904 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94f39b-ccfa-496d-b79e-d9c083e126f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:23:56.981206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94f39b-ccfa-496d-b79e-d9c083e126f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:23:56.990182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94f39b-ccfa-496d-b79e-d9c083e126f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:23:56.991582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94f39b-ccfa-496d-b79e-d9c083e126f0 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:23:57.000644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 778/1531] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:24:01.287004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d791194-a2f1-4c83-8abd-b62c3c9a9fa2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:24:01.287647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d791194-a2f1-4c83-8abd-b62c3c9a9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:24:01.287647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d791194-a2f1-4c83-8abd-b62c3c9a9fa2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:24:01.288893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 754/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:24:01.294419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab4b8-5d3b-499a-8996-001adc3e25a8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:24:01.294917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab4b8-5d3b-499a-8996-001adc3e25a8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:24:01.295020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab4b8-5d3b-499a-8996-001adc3e25a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:24:01.313457 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4eaab4b8-5d3b-499a-8996-001adc3e25a8 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:24:01.314664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4eaab4b8-5d3b-499a-8996-001adc3e25a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:24:01.322767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 779/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:24:01.597089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d791194-a2f1-4c83-8abd-b62c3c9a9fa2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:24:01.598772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3d791194-a2f1-4c83-8abd-b62c3c9a9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:24:01.654730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d791194-a2f1-4c83-8abd-b62c3c9a9fa2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:24:01.660288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df694378-83a7-47b5-92e9-39739704d234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:24:01.660945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df694378-83a7-47b5-92e9-39739704d234 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:24:01.661252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df694378-83a7-47b5-92e9-39739704d234 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:24:01.661527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df694378-83a7-47b5-92e9-39739704d234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:24:01.671572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df694378-83a7-47b5-92e9-39739704d234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:24:01.673041 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df694378-83a7-47b5-92e9-39739704d234 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:24:01.683046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 755/1534] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:24:04.063938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea633-ae78-441a-9ed7-2dc109a8140a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:24:04.064496 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea633-ae78-441a-9ed7-2dc109a8140a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:24:04.064496 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea633-ae78-441a-9ed7-2dc109a8140a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:24:04.066332 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 780/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 14:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:24:04.071605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d44c9e-a9d9-4e7f-86f6-c24af3e8fabf None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:24:04.072084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d44c9e-a9d9-4e7f-86f6-c24af3e8fabf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:24:04.072200 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d44c9e-a9d9-4e7f-86f6-c24af3e8fabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:24:04.090583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c5d44c9e-a9d9-4e7f-86f6-c24af3e8fabf None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:24:04.091784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c5d44c9e-a9d9-4e7f-86f6-c24af3e8fabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:24:04.100250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 756/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 14:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:24:04.372667 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663b73a-3cde-4e96-9795-08fcbc21e8d0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:24:04.372923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663b73a-3cde-4e96-9795-08fcbc21e8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:24:04.373241 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663b73a-3cde-4e96-9795-08fcbc21e8d0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:24:04.374605 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 781/1537] 10.222.0.61 () {54 vars in 962 bytes} [Tue Apr 12 14:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:24:04.379571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f1606-657c-4574-9bae-85f9a3c832e1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:24:04.379868 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f1606-657c-4574-9bae-85f9a3c832e1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:24:04.380148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f1606-657c-4574-9bae-85f9a3c832e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:24:04.400173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-110f1606-657c-4574-9bae-85f9a3c832e1 None None] MFA Rules not processed for user `c6ca11a750dc4234b4512e6274ca01a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:24:04.401447 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-110f1606-657c-4574-9bae-85f9a3c832e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:24:04.407903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 757/1538] 10.222.0.61 () {58 vars in 1059 bytes} [Tue Apr 12 14:24:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:24:04.416270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663b73a-3cde-4e96-9795-08fcbc21e8d0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:24:04.428705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663b73a-3cde-4e96-9795-08fcbc21e8d0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:24:04.432279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67752910-8bfe-4919-8d3d-e36444101d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:24:04.432916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67752910-8bfe-4919-8d3d-e36444101d37 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:24:04.433223 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67752910-8bfe-4919-8d3d-e36444101d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:24:04.433495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67752910-8bfe-4919-8d3d-e36444101d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:24:04.442805 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67752910-8bfe-4919-8d3d-e36444101d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:24:04.444222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67752910-8bfe-4919-8d3d-e36444101d37 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:24:04.453592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 782/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:37.477649 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa80d4-7341-4876-8f90-0e8072f48f96 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.478734 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa80d4-7341-4876-8f90-0e8072f48f96 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.479229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa80d4-7341-4876-8f90-0e8072f48f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:37.504849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3aaa80d4-7341-4876-8f90-0e8072f48f96 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:37.506557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3aaa80d4-7341-4876-8f90-0e8072f48f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:37.519233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 758/1540] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:37.530272 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f00e8d-7618-4f8f-aaac-52551dbdcf05 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.530863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f00e8d-7618-4f8f-aaac-52551dbdcf05 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.530863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f00e8d-7618-4f8f-aaac-52551dbdcf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:37.558644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-52f00e8d-7618-4f8f-aaac-52551dbdcf05 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:37.559887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-52f00e8d-7618-4f8f-aaac-52551dbdcf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:37.564126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036f88-c167-4028-abaf-31bc10c77fc7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.564688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036f88-c167-4028-abaf-31bc10c77fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.565213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036f88-c167-4028-abaf-31bc10c77fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:37.577287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 783/1541] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:37.588148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f00e8d-7618-4f8f-aaac-52551dbdcf05 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:37.592322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-95036f88-c167-4028-abaf-31bc10c77fc7 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:37.593649 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-95036f88-c167-4028-abaf-31bc10c77fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:37.598822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f00e8d-7618-4f8f-aaac-52551dbdcf05 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:37.609552 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 759/1542] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:37.611411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4343b-c65e-43cd-bdf5-99ba202f5969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:37.612353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4343b-c65e-43cd-bdf5-99ba202f5969 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.612823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4343b-c65e-43cd-bdf5-99ba202f5969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.613315 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4343b-c65e-43cd-bdf5-99ba202f5969 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:37.614471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4343b-c65e-43cd-bdf5-99ba202f5969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:25:37.614999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4343b-c65e-43cd-bdf5-99ba202f5969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:37.616432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-f5e4343b-c65e-43cd-bdf5-99ba202f5969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:25:37.616432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Apr 12 14:25:37.616432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: Apr 12 14:25:37.617852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4343b-c65e-43cd-bdf5-99ba202f5969 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:37.620914 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcf407-99af-49dc-9427-2d8770238a5b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.621809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcf407-99af-49dc-9427-2d8770238a5b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.621809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcf407-99af-49dc-9427-2d8770238a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:37.639210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 784/1543] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:25:37.662219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b0fcf407-99af-49dc-9427-2d8770238a5b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:37.663596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b0fcf407-99af-49dc-9427-2d8770238a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:37.670895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4343b-c65e-43cd-bdf5-99ba202f5969 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:37.692154 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 760/1544] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:25:37.697404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4343b-c65e-43cd-bdf5-99ba202f5969 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:37.698213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcf407-99af-49dc-9427-2d8770238a5b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:37.712953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcf407-99af-49dc-9427-2d8770238a5b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:37.721708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd570e4f-a084-4cba-a5eb-d4baa42d8844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:37.722866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570e4f-a084-4cba-a5eb-d4baa42d8844 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.723469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570e4f-a084-4cba-a5eb-d4baa42d8844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.723969 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570e4f-a084-4cba-a5eb-d4baa42d8844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:37.724928 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd570e4f-a084-4cba-a5eb-d4baa42d8844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:37.726966 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fa571-b70c-4ef3-a7d4-4e3e2952e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:37.727520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd570e4f-a084-4cba-a5eb-d4baa42d8844 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:37.727699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa571-b70c-4ef3-a7d4-4e3e2952e533 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.727906 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa571-b70c-4ef3-a7d4-4e3e2952e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.728180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa571-b70c-4ef3-a7d4-4e3e2952e533 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:37.728902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fa571-b70c-4ef3-a7d4-4e3e2952e533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:25:37.729233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fa571-b70c-4ef3-a7d4-4e3e2952e533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:37.732993 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fa571-b70c-4ef3-a7d4-4e3e2952e533 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:37.755461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 761/1545] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:25:37.756797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47380-c88f-489e-88db-8f7ea1d36a2e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.757110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47380-c88f-489e-88db-8f7ea1d36a2e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.757385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47380-c88f-489e-88db-8f7ea1d36a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:37.789309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-28e47380-c88f-489e-88db-8f7ea1d36a2e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:37.790540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-28e47380-c88f-489e-88db-8f7ea1d36a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:37.804114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 762/1546] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:37.805492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483c4e-c03d-4987-89b8-b586deca517d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.805777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483c4e-c03d-4987-89b8-b586deca517d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.806053 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483c4e-c03d-4987-89b8-b586deca517d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:37.832696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-98483c4e-c03d-4987-89b8-b586deca517d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:37.833923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-98483c4e-c03d-4987-89b8-b586deca517d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:37.847179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 763/1547] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:37.848366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98483c4e-c03d-4987-89b8-b586deca517d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:37.862733 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98483c4e-c03d-4987-89b8-b586deca517d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:37.864810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 785/1548] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:37 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:37.866419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05aa7-d7a2-47c6-b26b-54af7044deb8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.866943 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05aa7-d7a2-47c6-b26b-54af7044deb8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.867437 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05aa7-d7a2-47c6-b26b-54af7044deb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:37.902689 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-27c05aa7-d7a2-47c6-b26b-54af7044deb8 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:37.905515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-27c05aa7-d7a2-47c6-b26b-54af7044deb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:37.958057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695eb08-cbef-46c1-8583-58e68901beb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:37.959980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695eb08-cbef-46c1-8583-58e68901beb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.960493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695eb08-cbef-46c1-8583-58e68901beb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.961025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695eb08-cbef-46c1-8583-58e68901beb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:37.961942 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695eb08-cbef-46c1-8583-58e68901beb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:37.964241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-f695eb08-cbef-46c1-8583-58e68901beb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:25:37.964241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Apr 12 14:25:37.964241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: Apr 12 14:25:37.967001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695eb08-cbef-46c1-8583-58e68901beb0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:37.999956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 786/1549] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:37.999956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6e3ca-c646-47cc-870c-222d92fcec71 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:37.999956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6e3ca-c646-47cc-870c-222d92fcec71 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:37.999956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6e3ca-c646-47cc-870c-222d92fcec71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.018501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-80e6e3ca-c646-47cc-870c-222d92fcec71 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:38.019958 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-80e6e3ca-c646-47cc-870c-222d92fcec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:38.028132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 787/1550] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:38.030184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370ed4c-c6ff-4846-b1b4-f20b684dc1d3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.030467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370ed4c-c6ff-4846-b1b4-f20b684dc1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.030747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370ed4c-c6ff-4846-b1b4-f20b684dc1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.047952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8370ed4c-c6ff-4846-b1b4-f20b684dc1d3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:38.049167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8370ed4c-c6ff-4846-b1b4-f20b684dc1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:38.055749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 764/1551] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:37 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:38.056698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695eb08-cbef-46c1-8583-58e68901beb0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.060652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 788/1552] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:38.063233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d3937-767a-4e71-9fd3-cd5dbad47786 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.063233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d3937-767a-4e71-9fd3-cd5dbad47786 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.063233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d3937-767a-4e71-9fd3-cd5dbad47786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.082271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bd4d3937-767a-4e71-9fd3-cd5dbad47786 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:38.083468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bd4d3937-767a-4e71-9fd3-cd5dbad47786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:38.120956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695eb08-cbef-46c1-8583-58e68901beb0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.126048 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624fc3c-11df-45c4-8666-aeb1c748752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.126708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624fc3c-11df-45c4-8666-aeb1c748752b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.126986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624fc3c-11df-45c4-8666-aeb1c748752b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.127257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624fc3c-11df-45c4-8666-aeb1c748752b admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.127936 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624fc3c-11df-45c4-8666-aeb1c748752b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.129871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624fc3c-11df-45c4-8666-aeb1c748752b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.141567 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 789/1553] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:38.142487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d3937-767a-4e71-9fd3-cd5dbad47786 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.151507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d3937-767a-4e71-9fd3-cd5dbad47786 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.158432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9cc67-f23d-49b0-9a7a-4760c62616df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.158432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9cc67-f23d-49b0-9a7a-4760c62616df admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.158432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9cc67-f23d-49b0-9a7a-4760c62616df admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.158432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9cc67-f23d-49b0-9a7a-4760c62616df admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.158887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9cc67-f23d-49b0-9a7a-4760c62616df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:25:38.159201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9cc67-f23d-49b0-9a7a-4760c62616df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.160798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9cc67-f23d-49b0-9a7a-4760c62616df admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.172313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 790/1554] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:25:38.173696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6be5e-89e4-4bc6-83f1-6703dcc66f30 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.174023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6be5e-89e4-4bc6-83f1-6703dcc66f30 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.174307 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6be5e-89e4-4bc6-83f1-6703dcc66f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.192944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-13d6be5e-89e4-4bc6-83f1-6703dcc66f30 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:38.194249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-13d6be5e-89e4-4bc6-83f1-6703dcc66f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:38.202922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 791/1555] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:38.204127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79443bb-4426-4a5e-a022-fdcd9273701b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.204410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79443bb-4426-4a5e-a022-fdcd9273701b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.204687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79443bb-4426-4a5e-a022-fdcd9273701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.215929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 765/1556] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:38.217942 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624fc3c-11df-45c4-8666-aeb1c748752b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.224060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d79443bb-4426-4a5e-a022-fdcd9273701b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:38.225294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d79443bb-4426-4a5e-a022-fdcd9273701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:38.227785 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624fc3c-11df-45c4-8666-aeb1c748752b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.232930 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdfeea-ba0a-455e-b7ba-ccf69476f2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.233226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 792/1557] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:38.233605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdfeea-ba0a-455e-b7ba-ccf69476f2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.233890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdfeea-ba0a-455e-b7ba-ccf69476f2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.234012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79443bb-4426-4a5e-a022-fdcd9273701b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.234235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdfeea-ba0a-455e-b7ba-ccf69476f2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.234963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdfeea-ba0a-455e-b7ba-ccf69476f2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:25:38.235271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdfeea-ba0a-455e-b7ba-ccf69476f2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.236928 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdfeea-ba0a-455e-b7ba-ccf69476f2f7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.243685 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79443bb-4426-4a5e-a022-fdcd9273701b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.248844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43667df4-399c-4121-b8a5-a78bbc03f896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.249545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667df4-399c-4121-b8a5-a78bbc03f896 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.249828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667df4-399c-4121-b8a5-a78bbc03f896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.250187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667df4-399c-4121-b8a5-a78bbc03f896 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.250444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 766/1558] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:25:38.251856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c587edc-b7d2-4f22-9210-40134a0351e8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.252148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c587edc-b7d2-4f22-9210-40134a0351e8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.252592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c587edc-b7d2-4f22-9210-40134a0351e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.253497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43667df4-399c-4121-b8a5-a78bbc03f896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.254697 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-43667df4-399c-4121-b8a5-a78bbc03f896 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:25:38.254697 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Apr 12 14:25:38.254697 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: Apr 12 14:25:38.256218 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43667df4-399c-4121-b8a5-a78bbc03f896 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.271927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5c587edc-b7d2-4f22-9210-40134a0351e8 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:38.273206 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5c587edc-b7d2-4f22-9210-40134a0351e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:38.281688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 767/1559] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:38.282930 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa85356-8fb5-429e-b56f-4891297e7704 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.283217 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa85356-8fb5-429e-b56f-4891297e7704 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.283492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa85356-8fb5-429e-b56f-4891297e7704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.301295 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1fa85356-8fb5-429e-b56f-4891297e7704 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:38.302484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1fa85356-8fb5-429e-b56f-4891297e7704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:38.310280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 768/1560] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:38.314279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa85356-8fb5-429e-b56f-4891297e7704 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.320352 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa85356-8fb5-429e-b56f-4891297e7704 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.324827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8590d-2f76-4c43-9634-1716cf3205ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.330775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8590d-2f76-4c43-9634-1716cf3205ff admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.330775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8590d-2f76-4c43-9634-1716cf3205ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.330775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8590d-2f76-4c43-9634-1716cf3205ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.330775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8590d-2f76-4c43-9634-1716cf3205ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.330775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8590d-2f76-4c43-9634-1716cf3205ff admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.358946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 793/1561] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:38.360228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa99b3-fb0c-4000-b10d-9fdcc5d3fee6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.360518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa99b3-fb0c-4000-b10d-9fdcc5d3fee6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.360907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa99b3-fb0c-4000-b10d-9fdcc5d3fee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.379361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2bfa99b3-fb0c-4000-b10d-9fdcc5d3fee6 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:38.380544 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2bfa99b3-fb0c-4000-b10d-9fdcc5d3fee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:38.389308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 794/1562] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:38.390090 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa99b3-fb0c-4000-b10d-9fdcc5d3fee6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.400860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa99b3-fb0c-4000-b10d-9fdcc5d3fee6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.406468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b41eb4-d41b-43dd-abe6-c90ee34ca0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.407106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b41eb4-d41b-43dd-abe6-c90ee34ca0ae admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.407383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b41eb4-d41b-43dd-abe6-c90ee34ca0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.407652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b41eb4-d41b-43dd-abe6-c90ee34ca0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.408362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b41eb4-d41b-43dd-abe6-c90ee34ca0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.409954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b41eb4-d41b-43dd-abe6-c90ee34ca0ae admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.420862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 795/1563] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:38.422252 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6189e-f2ae-42c8-9e9d-eabfa9a62f10 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.422546 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6189e-f2ae-42c8-9e9d-eabfa9a62f10 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.422828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6189e-f2ae-42c8-9e9d-eabfa9a62f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.439987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 769/1564] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:38.440817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8590d-2f76-4c43-9634-1716cf3205ff admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.441362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-89f6189e-f2ae-42c8-9e9d-eabfa9a62f10 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:38.442861 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-89f6189e-f2ae-42c8-9e9d-eabfa9a62f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:38.502199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 796/1565] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:38.502941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6189e-f2ae-42c8-9e9d-eabfa9a62f10 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.503628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8590d-2f76-4c43-9634-1716cf3205ff admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.508444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ed6f3-5f3f-4691-a64b-1d2a62eb9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.509130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ed6f3-5f3f-4691-a64b-1d2a62eb9011 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.509414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ed6f3-5f3f-4691-a64b-1d2a62eb9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.509687 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ed6f3-5f3f-4691-a64b-1d2a62eb9011 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.510505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ed6f3-5f3f-4691-a64b-1d2a62eb9011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.512241 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6189e-f2ae-42c8-9e9d-eabfa9a62f10 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.512414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ed6f3-5f3f-4691-a64b-1d2a62eb9011 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.520606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fe9db-b511-4553-b7c8-e7455dde980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.521333 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fe9db-b511-4553-b7c8-e7455dde980f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.521620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fe9db-b511-4553-b7c8-e7455dde980f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.521975 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fe9db-b511-4553-b7c8-e7455dde980f admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.522625 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fe9db-b511-4553-b7c8-e7455dde980f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:25:38.522950 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fe9db-b511-4553-b7c8-e7455dde980f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.524604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fe9db-b511-4553-b7c8-e7455dde980f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.538023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 797/1566] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:25:38.538886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fe9db-b511-4553-b7c8-e7455dde980f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.549477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fe9db-b511-4553-b7c8-e7455dde980f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.554110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664cae4-0e3e-4ace-ab19-b3083e84696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.554743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664cae4-0e3e-4ace-ab19-b3083e84696e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.555025 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664cae4-0e3e-4ace-ab19-b3083e84696e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.555301 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664cae4-0e3e-4ace-ab19-b3083e84696e admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.556010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664cae4-0e3e-4ace-ab19-b3083e84696e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:25:38.556311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664cae4-0e3e-4ace-ab19-b3083e84696e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.557986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664cae4-0e3e-4ace-ab19-b3083e84696e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.570658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 798/1567] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:25:38.571634 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664cae4-0e3e-4ace-ab19-b3083e84696e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.572061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 770/1568] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:38.573138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ed6f3-5f3f-4691-a64b-1d2a62eb9011 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.587533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664cae4-0e3e-4ace-ab19-b3083e84696e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.637659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ed6f3-5f3f-4691-a64b-1d2a62eb9011 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.642523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52189f76-1326-4d61-afba-9b244b1a2b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.643178 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189f76-1326-4d61-afba-9b244b1a2b3a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.643460 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189f76-1326-4d61-afba-9b244b1a2b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.643733 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189f76-1326-4d61-afba-9b244b1a2b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.644453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52189f76-1326-4d61-afba-9b244b1a2b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:25:38.644647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fff17-31c8-464c-8ef1-7f7d9285a235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.644877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52189f76-1326-4d61-afba-9b244b1a2b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.645340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fff17-31c8-464c-8ef1-7f7d9285a235 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.645618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fff17-31c8-464c-8ef1-7f7d9285a235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.645893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fff17-31c8-464c-8ef1-7f7d9285a235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.646587 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52189f76-1326-4d61-afba-9b244b1a2b3a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.646700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fff17-31c8-464c-8ef1-7f7d9285a235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.648204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fff17-31c8-464c-8ef1-7f7d9285a235 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.661838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 799/1569] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:38.661838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fff17-31c8-464c-8ef1-7f7d9285a235 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.662119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 771/1570] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:25:38.662402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52189f76-1326-4d61-afba-9b244b1a2b3a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.673296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52189f76-1326-4d61-afba-9b244b1a2b3a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.676260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fff17-31c8-464c-8ef1-7f7d9285a235 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.678189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd1d98-a314-4da8-93b0-25442a155f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.678857 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd1d98-a314-4da8-93b0-25442a155f54 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.680241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd1d98-a314-4da8-93b0-25442a155f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.680241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd1d98-a314-4da8-93b0-25442a155f54 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.680241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd1d98-a314-4da8-93b0-25442a155f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.680837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792c30c-685c-43fd-99c8-7971aae2922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.681520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792c30c-685c-43fd-99c8-7971aae2922f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.681800 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792c30c-685c-43fd-99c8-7971aae2922f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.682072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792c30c-685c-43fd-99c8-7971aae2922f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.682171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd1d98-a314-4da8-93b0-25442a155f54 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.682785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792c30c-685c-43fd-99c8-7971aae2922f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.684354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792c30c-685c-43fd-99c8-7971aae2922f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.694808 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 800/1571] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:38.695749 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792c30c-685c-43fd-99c8-7971aae2922f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.705092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792c30c-685c-43fd-99c8-7971aae2922f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.709524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9114567-0b8c-40b4-94d7-4418dcbdf429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.710143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9114567-0b8c-40b4-94d7-4418dcbdf429 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.710428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9114567-0b8c-40b4-94d7-4418dcbdf429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.710701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9114567-0b8c-40b4-94d7-4418dcbdf429 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.711399 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9114567-0b8c-40b4-94d7-4418dcbdf429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:25:38.711729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9114567-0b8c-40b4-94d7-4418dcbdf429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.713303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9114567-0b8c-40b4-94d7-4418dcbdf429 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.725273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 801/1572] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:25:38.726185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9114567-0b8c-40b4-94d7-4418dcbdf429 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.736228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9114567-0b8c-40b4-94d7-4418dcbdf429 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.740912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a0d31-48a4-4403-8aa6-06566bcda53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.741573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0d31-48a4-4403-8aa6-06566bcda53c admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.741858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0d31-48a4-4403-8aa6-06566bcda53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.742152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0d31-48a4-4403-8aa6-06566bcda53c admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.742818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a0d31-48a4-4403-8aa6-06566bcda53c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.744666 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a0d31-48a4-4403-8aa6-06566bcda53c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.766311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 772/1573] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:38.766311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd1d98-a314-4da8-93b0-25442a155f54 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.774990 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd1d98-a314-4da8-93b0-25442a155f54 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.781865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd1ba1-7d5b-4877-8a9e-390ab09501db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.782517 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd1ba1-7d5b-4877-8a9e-390ab09501db admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.782797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd1ba1-7d5b-4877-8a9e-390ab09501db admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.783070 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd1ba1-7d5b-4877-8a9e-390ab09501db admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.783744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd1ba1-7d5b-4877-8a9e-390ab09501db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.785744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd1ba1-7d5b-4877-8a9e-390ab09501db admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.822838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 802/1574] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:38.823831 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a0d31-48a4-4403-8aa6-06566bcda53c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.894112 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a0d31-48a4-4403-8aa6-06566bcda53c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.898783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b036a65-d3c2-4ae3-80f3-8a5a04d4abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.899452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b036a65-d3c2-4ae3-80f3-8a5a04d4abf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.899734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b036a65-d3c2-4ae3-80f3-8a5a04d4abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.900013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b036a65-d3c2-4ae3-80f3-8a5a04d4abf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.900698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b036a65-d3c2-4ae3-80f3-8a5a04d4abf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.902679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b036a65-d3c2-4ae3-80f3-8a5a04d4abf7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.907445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 773/1575] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:38.909742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd1ba1-7d5b-4877-8a9e-390ab09501db admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.917947 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd1ba1-7d5b-4877-8a9e-390ab09501db admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.922638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbece04-5ab5-47ef-bfdd-01fff504f733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.923283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbece04-5ab5-47ef-bfdd-01fff504f733 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.923563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbece04-5ab5-47ef-bfdd-01fff504f733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.923838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbece04-5ab5-47ef-bfdd-01fff504f733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.924582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbece04-5ab5-47ef-bfdd-01fff504f733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.926242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbece04-5ab5-47ef-bfdd-01fff504f733 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.935974 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 774/1576] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:38.936728 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbece04-5ab5-47ef-bfdd-01fff504f733 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:38.946119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbece04-5ab5-47ef-bfdd-01fff504f733 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:38.951734 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa426e-d7dc-40e7-b1a7-f5dd96fcb760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:38.952385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa426e-d7dc-40e7-b1a7-f5dd96fcb760 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:38.952675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa426e-d7dc-40e7-b1a7-f5dd96fcb760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:38.953003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa426e-d7dc-40e7-b1a7-f5dd96fcb760 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:38.953717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa426e-d7dc-40e7-b1a7-f5dd96fcb760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:38.955628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa426e-d7dc-40e7-b1a7-f5dd96fcb760 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:38.993120 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 803/1577] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:38.993966 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b036a65-d3c2-4ae3-80f3-8a5a04d4abf7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.054591 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b036a65-d3c2-4ae3-80f3-8a5a04d4abf7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.059159 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c983eed-8803-4f8f-8e29-24bdc40cb096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.060577 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c983eed-8803-4f8f-8e29-24bdc40cb096 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.060880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c983eed-8803-4f8f-8e29-24bdc40cb096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.061182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c983eed-8803-4f8f-8e29-24bdc40cb096 admin admin] PATH_INFO: `/v3/projects/552466e02aac41228c5d9e25ad672187/users/53383037f8b94098a9d1b72151ca63fb/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.078268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 775/1578] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:38 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:39.078268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa426e-d7dc-40e7-b1a7-f5dd96fcb760 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.078593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c983eed-8803-4f8f-8e29-24bdc40cb096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552466e02aac41228c5d9e25ad672187, user_id=53383037f8b94098a9d1b72151ca63fb, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.079048 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c983eed-8803-4f8f-8e29-24bdc40cb096 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.135843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa426e-d7dc-40e7-b1a7-f5dd96fcb760 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.141445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152943d-3908-4d64-a1cc-0158fb673f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.142095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152943d-3908-4d64-a1cc-0158fb673f7e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.142377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152943d-3908-4d64-a1cc-0158fb673f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.142772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152943d-3908-4d64-a1cc-0158fb673f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.143455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152943d-3908-4d64-a1cc-0158fb673f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.145419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152943d-3908-4d64-a1cc-0158fb673f7e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.152427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 804/1579] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:38 2022] PUT /identity/v3/projects/552466e02aac41228c5d9e25ad672187/users/53383037f8b94098a9d1b72151ca63fb/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:39.162943 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c983eed-8803-4f8f-8e29-24bdc40cb096 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.225467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c983eed-8803-4f8f-8e29-24bdc40cb096 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.230109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696b486-56be-478b-955d-10648b898ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.230802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696b486-56be-478b-955d-10648b898ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.231080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696b486-56be-478b-955d-10648b898ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.231345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696b486-56be-478b-955d-10648b898ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.232626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696b486-56be-478b-955d-10648b898ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.232749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 776/1580] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:39 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:39.233500 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152943d-3908-4d64-a1cc-0158fb673f7e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.234276 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696b486-56be-478b-955d-10648b898ac3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.248540 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 805/1581] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:39.248540 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696b486-56be-478b-955d-10648b898ac3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.256267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696b486-56be-478b-955d-10648b898ac3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.297756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152943d-3908-4d64-a1cc-0158fb673f7e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.302803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ec6f-f4a6-4d9c-bfb4-4dde9b5b7814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.303471 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ec6f-f4a6-4d9c-bfb4-4dde9b5b7814 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.303754 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ec6f-f4a6-4d9c-bfb4-4dde9b5b7814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.304028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ec6f-f4a6-4d9c-bfb4-4dde9b5b7814 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.304776 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6ec6f-f4a6-4d9c-bfb4-4dde9b5b7814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.306669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6ec6f-f4a6-4d9c-bfb4-4dde9b5b7814 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.309563 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab072fac-ea23-4a1c-8681-d4726714edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.310906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab072fac-ea23-4a1c-8681-d4726714edc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.311393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab072fac-ea23-4a1c-8681-d4726714edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.311505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab072fac-ea23-4a1c-8681-d4726714edc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.312206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab072fac-ea23-4a1c-8681-d4726714edc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.314097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab072fac-ea23-4a1c-8681-d4726714edc7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.323648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 806/1582] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:39.324411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab072fac-ea23-4a1c-8681-d4726714edc7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.334548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab072fac-ea23-4a1c-8681-d4726714edc7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.339071 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224c6a2-89e8-4b61-b6b5-6008f71727e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.339912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224c6a2-89e8-4b61-b6b5-6008f71727e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.340213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224c6a2-89e8-4b61-b6b5-6008f71727e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.340470 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224c6a2-89e8-4b61-b6b5-6008f71727e6 admin admin] PATH_INFO: `/v3/projects/e143bfbb72ff477eb0314ce2e307742b/users/764047899a7f46569e12e14dda41b30d/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.358749 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224c6a2-89e8-4b61-b6b5-6008f71727e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e143bfbb72ff477eb0314ce2e307742b, user_id=764047899a7f46569e12e14dda41b30d, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.361554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224c6a2-89e8-4b61-b6b5-6008f71727e6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.385831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 777/1583] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:39 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:39.386771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ec6f-f4a6-4d9c-bfb4-4dde9b5b7814 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.398106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ec6f-f4a6-4d9c-bfb4-4dde9b5b7814 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.402851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763a1c2-5d61-440d-b553-7936e7f23b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.403533 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763a1c2-5d61-440d-b553-7936e7f23b46 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.404614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763a1c2-5d61-440d-b553-7936e7f23b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.404897 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763a1c2-5d61-440d-b553-7936e7f23b46 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.405617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763a1c2-5d61-440d-b553-7936e7f23b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.407557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763a1c2-5d61-440d-b553-7936e7f23b46 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.466705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 807/1584] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:39 2022] PUT /identity/v3/projects/e143bfbb72ff477eb0314ce2e307742b/users/764047899a7f46569e12e14dda41b30d/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:39.467583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224c6a2-89e8-4b61-b6b5-6008f71727e6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.496482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 778/1585] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:39 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:39.496675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982cbc4-1988-4cc7-be97-6f34a3af125f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.503814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982cbc4-1988-4cc7-be97-6f34a3af125f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.503814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982cbc4-1988-4cc7-be97-6f34a3af125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.524196 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0982cbc4-1988-4cc7-be97-6f34a3af125f None None] MFA Rules not processed for user `53383037f8b94098a9d1b72151ca63fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:39.525437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0982cbc4-1988-4cc7-be97-6f34a3af125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:39.530158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224c6a2-89e8-4b61-b6b5-6008f71727e6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.534828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3910cb-0f69-4107-aefb-6b809e555c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.535495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3910cb-0f69-4107-aefb-6b809e555c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.535776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3910cb-0f69-4107-aefb-6b809e555c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.536049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3910cb-0f69-4107-aefb-6b809e555c7a admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.536735 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3910cb-0f69-4107-aefb-6b809e555c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.538693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3910cb-0f69-4107-aefb-6b809e555c7a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.587576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 779/1586] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:39.588306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982cbc4-1988-4cc7-be97-6f34a3af125f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.600550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982cbc4-1988-4cc7-be97-6f34a3af125f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.605583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f46764-06b9-4ad3-a011-cc54b30aaa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.606244 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f46764-06b9-4ad3-a011-cc54b30aaa8a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.606523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f46764-06b9-4ad3-a011-cc54b30aaa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.606797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f46764-06b9-4ad3-a011-cc54b30aaa8a admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.607517 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f46764-06b9-4ad3-a011-cc54b30aaa8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.609542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f46764-06b9-4ad3-a011-cc54b30aaa8a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.656068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 808/1587] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:39 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:39.656885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3910cb-0f69-4107-aefb-6b809e555c7a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.666880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3910cb-0f69-4107-aefb-6b809e555c7a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.671649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295fe28-027d-46ae-a68b-dbadbc226eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.672345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295fe28-027d-46ae-a68b-dbadbc226eea admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.672630 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295fe28-027d-46ae-a68b-dbadbc226eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.672907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295fe28-027d-46ae-a68b-dbadbc226eea admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.673701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295fe28-027d-46ae-a68b-dbadbc226eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.675325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295fe28-027d-46ae-a68b-dbadbc226eea admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.685592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 809/1588] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:39.686991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295fe28-027d-46ae-a68b-dbadbc226eea admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.697054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295fe28-027d-46ae-a68b-dbadbc226eea admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.701714 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed19a3e-4997-41e7-96af-ca9cda2f23c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.703160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19a3e-4997-41e7-96af-ca9cda2f23c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.703475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19a3e-4997-41e7-96af-ca9cda2f23c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.703759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19a3e-4997-41e7-96af-ca9cda2f23c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.704479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed19a3e-4997-41e7-96af-ca9cda2f23c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.706190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed19a3e-4997-41e7-96af-ca9cda2f23c2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.716046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 780/1589] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:39 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:39.716046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f46764-06b9-4ad3-a011-cc54b30aaa8a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.720639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 810/1590] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:39.720639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caebb49-1500-4c22-97d5-ff5a913e5e4a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.720639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caebb49-1500-4c22-97d5-ff5a913e5e4a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.720639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caebb49-1500-4c22-97d5-ff5a913e5e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.724130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f46764-06b9-4ad3-a011-cc54b30aaa8a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.729027 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54265d35-0104-4fa5-9353-42c1a207bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.729742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265d35-0104-4fa5-9353-42c1a207bf7f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.730024 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265d35-0104-4fa5-9353-42c1a207bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.730299 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265d35-0104-4fa5-9353-42c1a207bf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.731027 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54265d35-0104-4fa5-9353-42c1a207bf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.732610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54265d35-0104-4fa5-9353-42c1a207bf7f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.736338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5caebb49-1500-4c22-97d5-ff5a913e5e4a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:39.737654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5caebb49-1500-4c22-97d5-ff5a913e5e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:39.743564 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 781/1591] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:39.744398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54265d35-0104-4fa5-9353-42c1a207bf7f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.748430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 811/1592] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:39.748430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83776970-7e0e-4b6d-9d38-7edacd75fc0c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.748430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83776970-7e0e-4b6d-9d38-7edacd75fc0c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.748430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83776970-7e0e-4b6d-9d38-7edacd75fc0c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.750185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 812/1593] 10.222.0.61 () {54 vars in 960 bytes} [Tue Apr 12 14:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:25:39.751035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83776970-7e0e-4b6d-9d38-7edacd75fc0c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.754982 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54265d35-0104-4fa5-9353-42c1a207bf7f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.760536 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380aae2-0c3e-427c-8a02-6b8b6518f269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.761238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380aae2-0c3e-427c-8a02-6b8b6518f269 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.761543 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380aae2-0c3e-427c-8a02-6b8b6518f269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.761821 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380aae2-0c3e-427c-8a02-6b8b6518f269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.762545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380aae2-0c3e-427c-8a02-6b8b6518f269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.764135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380aae2-0c3e-427c-8a02-6b8b6518f269 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.765174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83776970-7e0e-4b6d-9d38-7edacd75fc0c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.769989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb112a-993e-437d-83af-32a3ca2d8dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.770685 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb112a-993e-437d-83af-32a3ca2d8dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.771011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb112a-993e-437d-83af-32a3ca2d8dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.771296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb112a-993e-437d-83af-32a3ca2d8dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.772070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb112a-993e-437d-83af-32a3ca2d8dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.773806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb112a-993e-437d-83af-32a3ca2d8dd6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.775457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 782/1594] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:39.776456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380aae2-0c3e-427c-8a02-6b8b6518f269 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.784434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 813/1595] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:39.785311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb112a-993e-437d-83af-32a3ca2d8dd6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.786175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380aae2-0c3e-427c-8a02-6b8b6518f269 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.790659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aa8c2-c342-49d9-824d-1a0bba345279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.791528 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa8c2-c342-49d9-824d-1a0bba345279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.791862 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa8c2-c342-49d9-824d-1a0bba345279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.792138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa8c2-c342-49d9-824d-1a0bba345279 admin admin] PATH_INFO: `/v3/projects/ad74a5a84650412abfbb212fe4435e2b/users/ed8ac4a1b8744ff2b42747ddd7cb46d6/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.795255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb112a-993e-437d-83af-32a3ca2d8dd6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.800278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9404e31-7bb5-49e8-b7f2-b0c7ab830398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.800927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9404e31-7bb5-49e8-b7f2-b0c7ab830398 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.801244 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9404e31-7bb5-49e8-b7f2-b0c7ab830398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.801558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9404e31-7bb5-49e8-b7f2-b0c7ab830398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.802275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9404e31-7bb5-49e8-b7f2-b0c7ab830398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.803902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9404e31-7bb5-49e8-b7f2-b0c7ab830398 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.806444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aa8c2-c342-49d9-824d-1a0bba345279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad74a5a84650412abfbb212fe4435e2b, user_id=ed8ac4a1b8744ff2b42747ddd7cb46d6, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.807487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-ed9aa8c2-c342-49d9-824d-1a0bba345279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:25:39.807487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Apr 12 14:25:39.807487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: Apr 12 14:25:39.809519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aa8c2-c342-49d9-824d-1a0bba345279 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.815620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 814/1596] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:39.816516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9404e31-7bb5-49e8-b7f2-b0c7ab830398 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.830596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9404e31-7bb5-49e8-b7f2-b0c7ab830398 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.835434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d784fbc-6ae5-4cff-ace8-88813fc24e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:39.836340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d784fbc-6ae5-4cff-ace8-88813fc24e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:39.836625 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d784fbc-6ae5-4cff-ace8-88813fc24e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:39.836939 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d784fbc-6ae5-4cff-ace8-88813fc24e13 admin admin] PATH_INFO: `/v3/projects/764d5a64c9da4da5b783275fc596b8cf/users/09c78f8e913942e2826716f4679a2046/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:39.851603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d784fbc-6ae5-4cff-ace8-88813fc24e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=764d5a64c9da4da5b783275fc596b8cf, user_id=09c78f8e913942e2826716f4679a2046, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:39.854443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d784fbc-6ae5-4cff-ace8-88813fc24e13 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:39.916883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 783/1597] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:39 2022] PUT /identity/v3/projects/ad74a5a84650412abfbb212fe4435e2b/users/ed8ac4a1b8744ff2b42747ddd7cb46d6/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:39.917756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aa8c2-c342-49d9-824d-1a0bba345279 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.940948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 815/1598] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:39 2022] PUT /identity/v3/projects/764d5a64c9da4da5b783275fc596b8cf/users/09c78f8e913942e2826716f4679a2046/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:39.942393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d784fbc-6ae5-4cff-ace8-88813fc24e13 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:39.978942 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aa8c2-c342-49d9-824d-1a0bba345279 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:39.996812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d784fbc-6ae5-4cff-ace8-88813fc24e13 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:40.001100 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06754-6afb-4d56-847e-cd03986fad9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:40.001745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06754-6afb-4d56-847e-cd03986fad9d service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.002027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06754-6afb-4d56-847e-cd03986fad9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.002302 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06754-6afb-4d56-847e-cd03986fad9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.035520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7673ab-7b7b-44ef-b241-5fe5c007e407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:40.036180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7673ab-7b7b-44ef-b241-5fe5c007e407 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.036460 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7673ab-7b7b-44ef-b241-5fe5c007e407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.036731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7673ab-7b7b-44ef-b241-5fe5c007e407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.037474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7673ab-7b7b-44ef-b241-5fe5c007e407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:40.039059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7673ab-7b7b-44ef-b241-5fe5c007e407 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:40.049017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 784/1599] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:40.050263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e75254-3371-46a3-b83e-11252dc5a597 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.050546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e75254-3371-46a3-b83e-11252dc5a597 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.050820 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e75254-3371-46a3-b83e-11252dc5a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.065124 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b06754-6afb-4d56-847e-cd03986fad9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:40.066771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b06754-6afb-4d56-847e-cd03986fad9d service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:40.069480 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-82e75254-3371-46a3-b83e-11252dc5a597 None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:40.070669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-82e75254-3371-46a3-b83e-11252dc5a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:40.077390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 816/1600] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:40.078277 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06754-6afb-4d56-847e-cd03986fad9d service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:40.087850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06754-6afb-4d56-847e-cd03986fad9d service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:40.094123 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ff64-66e1-491e-b8ba-408a4012626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:40.094795 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ff64-66e1-491e-b8ba-408a4012626b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.095078 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ff64-66e1-491e-b8ba-408a4012626b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.095442 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ff64-66e1-491e-b8ba-408a4012626b admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.096117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66ff64-66e1-491e-b8ba-408a4012626b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:40.097789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66ff64-66e1-491e-b8ba-408a4012626b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:40.109567 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 817/1601] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:40.110004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ff64-66e1-491e-b8ba-408a4012626b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:40.119701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ff64-66e1-491e-b8ba-408a4012626b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:40.124886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e2804-9c3f-4746-a106-6fdd4e3838b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:40.125564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e2804-9c3f-4746-a106-6fdd4e3838b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.125959 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e2804-9c3f-4746-a106-6fdd4e3838b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.126355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e2804-9c3f-4746-a106-6fdd4e3838b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.127194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e2804-9c3f-4746-a106-6fdd4e3838b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:40.128657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e2804-9c3f-4746-a106-6fdd4e3838b9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:40.138392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 818/1602] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:40.139247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e2804-9c3f-4746-a106-6fdd4e3838b9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:40.141187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 785/1603] 10.222.0.61 () {58 vars in 1057 bytes} [Tue Apr 12 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:40.142300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ec45-67a1-47ba-902c-5c2e55f661d6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.142592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ec45-67a1-47ba-902c-5c2e55f661d6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.142964 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ec45-67a1-47ba-902c-5c2e55f661d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.149777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e2804-9c3f-4746-a106-6fdd4e3838b9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:40.154541 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2922984-f2d3-4736-a0dd-58c570842808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:40.155355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2922984-f2d3-4736-a0dd-58c570842808 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.155862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2922984-f2d3-4736-a0dd-58c570842808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.156327 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2922984-f2d3-4736-a0dd-58c570842808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.157221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2922984-f2d3-4736-a0dd-58c570842808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:40.158809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2922984-f2d3-4736-a0dd-58c570842808 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:40.161726 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ea86ec45-67a1-47ba-902c-5c2e55f661d6 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:40.163012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ea86ec45-67a1-47ba-902c-5c2e55f661d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:40.170316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 819/1604] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:40.180444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ece90-ae9f-4c90-a757-2dae47a832a7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.180444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ece90-ae9f-4c90-a757-2dae47a832a7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.180444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ece90-ae9f-4c90-a757-2dae47a832a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.181182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 786/1605] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:40.181182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ec45-67a1-47ba-902c-5c2e55f661d6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:40.193453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ec45-67a1-47ba-902c-5c2e55f661d6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:40.199505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35892-d687-4a4b-a781-93d5874c97c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:40.200440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35892-d687-4a4b-a781-93d5874c97c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.200715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35892-d687-4a4b-a781-93d5874c97c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.201050 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35892-d687-4a4b-a781-93d5874c97c2 admin admin] PATH_INFO: `/v3/projects/d8251f0508404f13b224cdc907726798/users/8459b0ded67a4812955eb69f3f28be64/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.219767 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c35892-d687-4a4b-a781-93d5874c97c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8251f0508404f13b224cdc907726798, user_id=8459b0ded67a4812955eb69f3f28be64, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:40.222766 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c35892-d687-4a4b-a781-93d5874c97c2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:40.224057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-df5ece90-ae9f-4c90-a757-2dae47a832a7 None None] MFA Rules not processed for user `09c78f8e913942e2826716f4679a2046`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:40.225389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-df5ece90-ae9f-4c90-a757-2dae47a832a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:40.292043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 820/1606] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:40.292864 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ece90-ae9f-4c90-a757-2dae47a832a7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:40.300259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 787/1607] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:40 2022] PUT /identity/v3/projects/d8251f0508404f13b224cdc907726798/users/8459b0ded67a4812955eb69f3f28be64/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:40.301198 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35892-d687-4a4b-a781-93d5874c97c2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:40.308187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ece90-ae9f-4c90-a757-2dae47a832a7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:40.371674 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3047d-15fa-42c8-8d20-fd232f6fbb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:40.373670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3047d-15fa-42c8-8d20-fd232f6fbb86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.374018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3047d-15fa-42c8-8d20-fd232f6fbb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.374442 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3047d-15fa-42c8-8d20-fd232f6fbb86 admin admin] PATH_INFO: `/v3/projects/9b35d4f1f2124b17b32c97ef1876ab53/users/6388423ccb4f44a0981a8b994fd222ed/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.376064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35892-d687-4a4b-a781-93d5874c97c2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:40.381160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580544f-083f-4168-8362-5563c9941301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:40.382172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580544f-083f-4168-8362-5563c9941301 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.382828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580544f-083f-4168-8362-5563c9941301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.383133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580544f-083f-4168-8362-5563c9941301 admin admin] PATH_INFO: `/v3/projects/01f26170c3294efc8e2156d7bbf0f995/users/ceb69d85e1f24983aa9de1557e468494/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.393360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3047d-15fa-42c8-8d20-fd232f6fbb86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b35d4f1f2124b17b32c97ef1876ab53, user_id=6388423ccb4f44a0981a8b994fd222ed, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:40.396663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3047d-15fa-42c8-8d20-fd232f6fbb86 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:40.402367 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580544f-083f-4168-8362-5563c9941301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f26170c3294efc8e2156d7bbf0f995, user_id=ceb69d85e1f24983aa9de1557e468494, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:40.403827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580544f-083f-4168-8362-5563c9941301 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:40.473356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 821/1608] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:40 2022] PUT /identity/v3/projects/9b35d4f1f2124b17b32c97ef1876ab53/users/6388423ccb4f44a0981a8b994fd222ed/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:40.474197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3047d-15fa-42c8-8d20-fd232f6fbb86 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:40.500882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 788/1609] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:40 2022] PUT /identity/v3/projects/01f26170c3294efc8e2156d7bbf0f995/users/ceb69d85e1f24983aa9de1557e468494/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:40.501717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580544f-083f-4168-8362-5563c9941301 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:40.547011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3047d-15fa-42c8-8d20-fd232f6fbb86 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:40.564077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580544f-083f-4168-8362-5563c9941301 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:40.570475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44e6a3-e376-4832-8764-1415c8a9a1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:40.571360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44e6a3-e376-4832-8764-1415c8a9a1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.571643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44e6a3-e376-4832-8764-1415c8a9a1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.571917 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44e6a3-e376-4832-8764-1415c8a9a1dd admin admin] PATH_INFO: `/v3/projects/589a58988caf47bbb487e286622d2fb0/users/ef302e14eee14a7c9c05eeaa40cc1ed0/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.586810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44e6a3-e376-4832-8764-1415c8a9a1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=589a58988caf47bbb487e286622d2fb0, user_id=ef302e14eee14a7c9c05eeaa40cc1ed0, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:40.589586 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44e6a3-e376-4832-8764-1415c8a9a1dd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:40.622842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da98986-7a36-4aff-86d1-0943a6822b9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:40.623450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da98986-7a36-4aff-86d1-0943a6822b9f service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.623759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da98986-7a36-4aff-86d1-0943a6822b9f service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.624038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da98986-7a36-4aff-86d1-0943a6822b9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.688249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da98986-7a36-4aff-86d1-0943a6822b9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:40.690128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da98986-7a36-4aff-86d1-0943a6822b9f service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:40.700804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 822/1610] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:40.701659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da98986-7a36-4aff-86d1-0943a6822b9f service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:40.703818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3da98986-7a36-4aff-86d1-0943a6822b9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:40.719524 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 789/1611] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:40 2022] PUT /identity/v3/projects/589a58988caf47bbb487e286622d2fb0/users/ef302e14eee14a7c9c05eeaa40cc1ed0/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:40.721194 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173630cf-e337-45ee-aef5-726815bd1a8d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.721392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173630cf-e337-45ee-aef5-726815bd1a8d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.721690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173630cf-e337-45ee-aef5-726815bd1a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.751551 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-173630cf-e337-45ee-aef5-726815bd1a8d None None] MFA Rules not processed for user `8459b0ded67a4812955eb69f3f28be64`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:40.752803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-173630cf-e337-45ee-aef5-726815bd1a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:40.797356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da98986-7a36-4aff-86d1-0943a6822b9f service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:40.824293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 790/1612] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:40.830744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feca15-cd67-4c96-af67-3789d9e101cb None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.831478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feca15-cd67-4c96-af67-3789d9e101cb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.831478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feca15-cd67-4c96-af67-3789d9e101cb None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.833426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 791/1613] 10.222.0.61 () {54 vars in 960 bytes} [Tue Apr 12 14:25:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:25:40.834721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99d0e3-ea19-49e8-9b05-dbbc8d4783c3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.835086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99d0e3-ea19-49e8-9b05-dbbc8d4783c3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.835425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99d0e3-ea19-49e8-9b05-dbbc8d4783c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.855736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fd99d0e3-ea19-49e8-9b05-dbbc8d4783c3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:40.857772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fd99d0e3-ea19-49e8-9b05-dbbc8d4783c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:40.878944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ac3d3-5a26-470a-b3a4-39b3e2248575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:40.879998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ac3d3-5a26-470a-b3a4-39b3e2248575 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.880753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ac3d3-5a26-470a-b3a4-39b3e2248575 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.881218 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ac3d3-5a26-470a-b3a4-39b3e2248575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.929282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 792/1614] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:40.930765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fa462-aa4a-4019-ab30-cd773a45fbd3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.931116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fa462-aa4a-4019-ab30-cd773a45fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.931460 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fa462-aa4a-4019-ab30-cd773a45fbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.958477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1a5fa462-aa4a-4019-ab30-cd773a45fbd3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:40.959667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1a5fa462-aa4a-4019-ab30-cd773a45fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:40.967321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 793/1615] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:40.969582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459139a8-028b-4f53-a58f-b5a012c85faa None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:40.969868 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459139a8-028b-4f53-a58f-b5a012c85faa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:40.970559 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459139a8-028b-4f53-a58f-b5a012c85faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:40.974954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ac3d3-5a26-470a-b3a4-39b3e2248575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:40.976569 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ac3d3-5a26-470a-b3a4-39b3e2248575 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:40.986554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 823/1616] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:40.987435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ac3d3-5a26-470a-b3a4-39b3e2248575 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:41.000055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-459139a8-028b-4f53-a58f-b5a012c85faa None None] MFA Rules not processed for user `ef302e14eee14a7c9c05eeaa40cc1ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:41.001306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-459139a8-028b-4f53-a58f-b5a012c85faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:41.048392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ac3d3-5a26-470a-b3a4-39b3e2248575 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:41.053506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd3bbd-b5b7-4ce5-97e6-df71a6838d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:41.054273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd3bbd-b5b7-4ce5-97e6-df71a6838d79 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.054650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd3bbd-b5b7-4ce5-97e6-df71a6838d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.055023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd3bbd-b5b7-4ce5-97e6-df71a6838d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.067499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd3bbd-b5b7-4ce5-97e6-df71a6838d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:41.070548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd3bbd-b5b7-4ce5-97e6-df71a6838d79 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:41.071496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 794/1617] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:41.072756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9d75-5147-4e55-b78c-55ad7efa9c3f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.073182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9d75-5147-4e55-b78c-55ad7efa9c3f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.073561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9d75-5147-4e55-b78c-55ad7efa9c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.083678 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 824/1618] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:41.084176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd3bbd-b5b7-4ce5-97e6-df71a6838d79 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:41.093667 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd3bbd-b5b7-4ce5-97e6-df71a6838d79 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:41.095713 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3ecd9d75-5147-4e55-b78c-55ad7efa9c3f None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:41.096827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3ecd9d75-5147-4e55-b78c-55ad7efa9c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:41.098145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b240cd-ab47-4342-9684-8e33d48e9239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:41.098993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b240cd-ab47-4342-9684-8e33d48e9239 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.099401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b240cd-ab47-4342-9684-8e33d48e9239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.099811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b240cd-ab47-4342-9684-8e33d48e9239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.111638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b240cd-ab47-4342-9684-8e33d48e9239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:41.113170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b240cd-ab47-4342-9684-8e33d48e9239 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:41.125186 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 825/1619] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:41.127025 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082c4fc-18e1-4264-99da-4cba03b1f450 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.127486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082c4fc-18e1-4264-99da-4cba03b1f450 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.127904 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082c4fc-18e1-4264-99da-4cba03b1f450 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.129875 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 826/1620] 10.222.0.61 () {54 vars in 912 bytes} [Tue Apr 12 14:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:25:41.130794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082c4fc-18e1-4264-99da-4cba03b1f450 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:41.151150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082c4fc-18e1-4264-99da-4cba03b1f450 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:41.155434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11e011-30a8-4abe-9a75-09b576505534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:41.156460 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e011-30a8-4abe-9a75-09b576505534 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.156845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e011-30a8-4abe-9a75-09b576505534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.157254 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e011-30a8-4abe-9a75-09b576505534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.168941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11e011-30a8-4abe-9a75-09b576505534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:41.170794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11e011-30a8-4abe-9a75-09b576505534 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:41.182730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 827/1621] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:41.183587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11e011-30a8-4abe-9a75-09b576505534 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:41.195469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11e011-30a8-4abe-9a75-09b576505534 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:41.200676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 795/1622] 10.222.0.61 () {58 vars in 1057 bytes} [Tue Apr 12 14:25:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:41.203171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f68335-a660-4b4c-85a4-5476d868a64a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.203813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f68335-a660-4b4c-85a4-5476d868a64a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.204401 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f68335-a660-4b4c-85a4-5476d868a64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.213137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ef86a-25d2-47b4-aadc-7eda15ef0530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:41.218915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef86a-25d2-47b4-aadc-7eda15ef0530 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.218915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef86a-25d2-47b4-aadc-7eda15ef0530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.218915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef86a-25d2-47b4-aadc-7eda15ef0530 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.218915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ef86a-25d2-47b4-aadc-7eda15ef0530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:41.218915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ef86a-25d2-47b4-aadc-7eda15ef0530 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:41.227420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d3f68335-a660-4b4c-85a4-5476d868a64a None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:41.229458 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d3f68335-a660-4b4c-85a4-5476d868a64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:41.240288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 796/1623] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:25:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:41.241162 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f68335-a660-4b4c-85a4-5476d868a64a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:41.254421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f68335-a660-4b4c-85a4-5476d868a64a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:41.260471 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f1b32-d49c-4de3-bea9-5cd1be7342b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:41.261311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1b32-d49c-4de3-bea9-5cd1be7342b1 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.261724 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1b32-d49c-4de3-bea9-5cd1be7342b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.262015 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1b32-d49c-4de3-bea9-5cd1be7342b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.355382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 828/1624] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:41 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:41.356249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ef86a-25d2-47b4-aadc-7eda15ef0530 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:41.399989 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f1b32-d49c-4de3-bea9-5cd1be7342b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:41.402004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f1b32-d49c-4de3-bea9-5cd1be7342b1 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:41.423824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 797/1625] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:41.425021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f1b32-d49c-4de3-bea9-5cd1be7342b1 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:41.448028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f1b32-d49c-4de3-bea9-5cd1be7342b1 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:41.525975 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ef86a-25d2-47b4-aadc-7eda15ef0530 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:41.538950 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b6ada-524a-4bea-9b08-866845da2c5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:41.539769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b6ada-524a-4bea-9b08-866845da2c5d service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.539933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b6ada-524a-4bea-9b08-866845da2c5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.540156 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b6ada-524a-4bea-9b08-866845da2c5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.565939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100e41a-34d2-4780-bcd9-64c133a1b8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:41.566658 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100e41a-34d2-4780-bcd9-64c133a1b8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.566946 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100e41a-34d2-4780-bcd9-64c133a1b8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.567218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100e41a-34d2-4780-bcd9-64c133a1b8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.568052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100e41a-34d2-4780-bcd9-64c133a1b8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:41.570220 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100e41a-34d2-4780-bcd9-64c133a1b8c1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:41.635146 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b6ada-524a-4bea-9b08-866845da2c5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:41.637246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b6ada-524a-4bea-9b08-866845da2c5d service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:41.652633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 829/1626] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:41.681946 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 798/1627] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:41 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:41.685658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b6ada-524a-4bea-9b08-866845da2c5d service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:41.711295 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b6ada-524a-4bea-9b08-866845da2c5d service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:41.726732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa3f7d-4a91-4fb7-8bf5-b7fd0c5dda47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:41.727768 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3f7d-4a91-4fb7-8bf5-b7fd0c5dda47 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.728199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3f7d-4a91-4fb7-8bf5-b7fd0c5dda47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.728536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3f7d-4a91-4fb7-8bf5-b7fd0c5dda47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.729361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa3f7d-4a91-4fb7-8bf5-b7fd0c5dda47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:41.736175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa3f7d-4a91-4fb7-8bf5-b7fd0c5dda47 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:41.757317 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 830/1628] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:41.760423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100e41a-34d2-4780-bcd9-64c133a1b8c1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:41.779604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100e41a-34d2-4780-bcd9-64c133a1b8c1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:41.806935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d27bcb-dc96-45f9-82cf-2795ab7b04f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:41.807709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d27bcb-dc96-45f9-82cf-2795ab7b04f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.811279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d27bcb-dc96-45f9-82cf-2795ab7b04f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.811279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d27bcb-dc96-45f9-82cf-2795ab7b04f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.812013 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d27bcb-dc96-45f9-82cf-2795ab7b04f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:41.822168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d27bcb-dc96-45f9-82cf-2795ab7b04f0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:41.830383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6317a8-ff9f-46a2-b022-a2597c626013 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.830667 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6317a8-ff9f-46a2-b022-a2597c626013 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.831082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6317a8-ff9f-46a2-b022-a2597c626013 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.832559 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 831/1629] 10.222.0.61 () {54 vars in 912 bytes} [Tue Apr 12 14:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:25:41.841731 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c56a96-e32d-4d0d-bb58-d6882ec37b23 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.841731 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c56a96-e32d-4d0d-bb58-d6882ec37b23 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.841731 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c56a96-e32d-4d0d-bb58-d6882ec37b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.853432 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 799/1630] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:41.854308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d27bcb-dc96-45f9-82cf-2795ab7b04f0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:41.888997 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d27bcb-dc96-45f9-82cf-2795ab7b04f0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:41.894941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b7c56a96-e32d-4d0d-bb58-d6882ec37b23 None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:41.897102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b7c56a96-e32d-4d0d-bb58-d6882ec37b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:41.922642 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c58bc-2586-416e-8cfb-ecf0595b39c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:41.923544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c58bc-2586-416e-8cfb-ecf0595b39c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:41.923822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c58bc-2586-416e-8cfb-ecf0595b39c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:41.924092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c58bc-2586-416e-8cfb-ecf0595b39c4 admin admin] PATH_INFO: `/v3/projects/19d1dbb8dc594e5a852fa9a112c950a4/users/9bd77a790548433f8700e16723c4bbff/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:41.949507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 832/1631] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:25:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:25:41.974365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c58bc-2586-416e-8cfb-ecf0595b39c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d1dbb8dc594e5a852fa9a112c950a4, user_id=9bd77a790548433f8700e16723c4bbff, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:41.978812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c58bc-2586-416e-8cfb-ecf0595b39c4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:42.069211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 800/1632] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:41 2022] PUT /identity/v3/projects/19d1dbb8dc594e5a852fa9a112c950a4/users/9bd77a790548433f8700e16723c4bbff/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:42.077482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eead15-7b21-4ce7-8fb5-ff27a14b87a7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:42.077831 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eead15-7b21-4ce7-8fb5-ff27a14b87a7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:42.078035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eead15-7b21-4ce7-8fb5-ff27a14b87a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:42.110802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-20eead15-7b21-4ce7-8fb5-ff27a14b87a7 None None] MFA Rules not processed for user `9bd77a790548433f8700e16723c4bbff`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:42.112154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-20eead15-7b21-4ce7-8fb5-ff27a14b87a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:42.184228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 833/1633] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:42.187169 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c58bc-2586-416e-8cfb-ecf0595b39c4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:42.290997 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eead15-7b21-4ce7-8fb5-ff27a14b87a7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:42.344706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c58bc-2586-416e-8cfb-ecf0595b39c4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:42.357411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979013ef-28c0-4bd5-9525-efeab80935c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:42.366021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979013ef-28c0-4bd5-9525-efeab80935c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:42.366021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979013ef-28c0-4bd5-9525-efeab80935c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:42.366021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979013ef-28c0-4bd5-9525-efeab80935c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:42.366021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979013ef-28c0-4bd5-9525-efeab80935c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:42.366021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979013ef-28c0-4bd5-9525-efeab80935c2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:42.407134 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eead15-7b21-4ce7-8fb5-ff27a14b87a7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:42.411154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77c974-e592-46f0-9bd0-121e415f427c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:42.411872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77c974-e592-46f0-9bd0-121e415f427c service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:42.414199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77c974-e592-46f0-9bd0-121e415f427c service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:42.414199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77c974-e592-46f0-9bd0-121e415f427c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:42.505378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77c974-e592-46f0-9bd0-121e415f427c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:42.507105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77c974-e592-46f0-9bd0-121e415f427c service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:42.530943 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 801/1634] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:42 2022] POST /identity/v3/projects => generated 385 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:42.535845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979013ef-28c0-4bd5-9525-efeab80935c2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:42.545520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 834/1635] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:25:42.660657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979013ef-28c0-4bd5-9525-efeab80935c2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:42.667794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a9126-464e-4b18-b4dc-87e4d9f04e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:42.668591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9126-464e-4b18-b4dc-87e4d9f04e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:42.669025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9126-464e-4b18-b4dc-87e4d9f04e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:42.669424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9126-464e-4b18-b4dc-87e4d9f04e8a admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:42.670260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a9126-464e-4b18-b4dc-87e4d9f04e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:42.672569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a9126-464e-4b18-b4dc-87e4d9f04e8a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:42.791987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 802/1636] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:42 2022] POST /identity/v3/users => generated 299 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:42.793653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77c974-e592-46f0-9bd0-121e415f427c service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:42.826211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77c974-e592-46f0-9bd0-121e415f427c service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:42.833551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036476c0-7f30-4a6c-b9ad-38d833a82bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:42.834953 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036476c0-7f30-4a6c-b9ad-38d833a82bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:42.835414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036476c0-7f30-4a6c-b9ad-38d833a82bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:42.835837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036476c0-7f30-4a6c-b9ad-38d833a82bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:42.837491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036476c0-7f30-4a6c-b9ad-38d833a82bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:42.839672 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036476c0-7f30-4a6c-b9ad-38d833a82bfd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:42.857392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 835/1637] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:42.861828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a9126-464e-4b18-b4dc-87e4d9f04e8a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:42.876897 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a9126-464e-4b18-b4dc-87e4d9f04e8a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:42.897201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f22f6-d834-4cd2-86f7-4453726cd790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:42.898321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f22f6-d834-4cd2-86f7-4453726cd790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:42.899927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f22f6-d834-4cd2-86f7-4453726cd790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:42.900315 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f22f6-d834-4cd2-86f7-4453726cd790 admin admin] PATH_INFO: `/v3/projects/88e634eecb394597a56e7f87f369e7de/users/cf4869663dd3407d9acbaca9d26ff46e/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:42.949986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f22f6-d834-4cd2-86f7-4453726cd790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e634eecb394597a56e7f87f369e7de, user_id=cf4869663dd3407d9acbaca9d26ff46e, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:42.953217 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f22f6-d834-4cd2-86f7-4453726cd790 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:43.057335 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb3219-f031-4735-9403-cc4feae7e6b4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:43.057750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb3219-f031-4735-9403-cc4feae7e6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:43.058138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb3219-f031-4735-9403-cc4feae7e6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:43.115093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-07cb3219-f031-4735-9403-cc4feae7e6b4 None None] MFA Rules not processed for user `ed8ac4a1b8744ff2b42747ddd7cb46d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:43.118219 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-07cb3219-f031-4735-9403-cc4feae7e6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:43.121253 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 803/1638] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:42 2022] PUT /identity/v3/projects/88e634eecb394597a56e7f87f369e7de/users/cf4869663dd3407d9acbaca9d26ff46e/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:43.136953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f22f6-d834-4cd2-86f7-4453726cd790 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:43.377138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f22f6-d834-4cd2-86f7-4453726cd790 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:43.383606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c1d2e-9753-4bec-b55a-087f4adef2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:43.384525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c1d2e-9753-4bec-b55a-087f4adef2de admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:43.384859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c1d2e-9753-4bec-b55a-087f4adef2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:43.385349 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c1d2e-9753-4bec-b55a-087f4adef2de admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:43.386562 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c1d2e-9753-4bec-b55a-087f4adef2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:43.389335 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c1d2e-9753-4bec-b55a-087f4adef2de admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:43.413860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 836/1639] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:25:43.413860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb3219-f031-4735-9403-cc4feae7e6b4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:43.414288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 804/1640] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:43.419780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0763a-25f0-4e0f-b52a-16c43ef2514a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:43.420490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0763a-25f0-4e0f-b52a-16c43ef2514a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:43.422677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0763a-25f0-4e0f-b52a-16c43ef2514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:43.440448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb3219-f031-4735-9403-cc4feae7e6b4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:43.459979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa168d74-f215-400e-9239-a9a9269c2c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:43.459979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa168d74-f215-400e-9239-a9a9269c2c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:43.459979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa168d74-f215-400e-9239-a9a9269c2c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:43.459979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa168d74-f215-400e-9239-a9a9269c2c7f admin admin] PATH_INFO: `/v3/projects/88e634eecb394597a56e7f87f369e7de/users/cf4869663dd3407d9acbaca9d26ff46e/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:43.460781 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa168d74-f215-400e-9239-a9a9269c2c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e634eecb394597a56e7f87f369e7de, user_id=cf4869663dd3407d9acbaca9d26ff46e, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:43.463664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa168d74-f215-400e-9239-a9a9269c2c7f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:43.473802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bfe0763a-25f0-4e0f-b52a-16c43ef2514a None None] MFA Rules not processed for user `ed8ac4a1b8744ff2b42747ddd7cb46d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:43.478464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bfe0763a-25f0-4e0f-b52a-16c43ef2514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:43.503680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 837/1641] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:43 2022] PUT /identity/v3/projects/88e634eecb394597a56e7f87f369e7de/users/cf4869663dd3407d9acbaca9d26ff46e/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:25:43.507911 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a4dd-6576-4f5d-80e8-b43982856a33 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:43.511133 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a4dd-6576-4f5d-80e8-b43982856a33 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:43.511482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a4dd-6576-4f5d-80e8-b43982856a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:43.583857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-00d5a4dd-6576-4f5d-80e8-b43982856a33 None None] MFA Rules not processed for user `cf4869663dd3407d9acbaca9d26ff46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:43.587132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-00d5a4dd-6576-4f5d-80e8-b43982856a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:43.632006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 805/1642] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:43.644405 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0763a-25f0-4e0f-b52a-16c43ef2514a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:43.719742 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 838/1643] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:43.727960 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5a4dd-6576-4f5d-80e8-b43982856a33 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:43.793148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0763a-25f0-4e0f-b52a-16c43ef2514a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:43.801155 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce7d39-932d-48dc-a0a6-e30779e48193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:43.801155 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce7d39-932d-48dc-a0a6-e30779e48193 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:43.801571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce7d39-932d-48dc-a0a6-e30779e48193 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:43.801680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce7d39-932d-48dc-a0a6-e30779e48193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:43.814829 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce7d39-932d-48dc-a0a6-e30779e48193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:43.820166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce7d39-932d-48dc-a0a6-e30779e48193 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:43.850689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 806/1644] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:25:43.871627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5a4dd-6576-4f5d-80e8-b43982856a33 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:43.876232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214875f1-d6cd-44f5-809c-332a22fc859c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:43.877671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214875f1-d6cd-44f5-809c-332a22fc859c service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:43.877671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214875f1-d6cd-44f5-809c-332a22fc859c service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:43.878432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214875f1-d6cd-44f5-809c-332a22fc859c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:43.892687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214875f1-d6cd-44f5-809c-332a22fc859c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:43.894580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214875f1-d6cd-44f5-809c-332a22fc859c service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:43.910930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 839/1645] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:25:44.901479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef489b4d-bbf9-4b75-a167-10335fc2067c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:44.902043 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef489b4d-bbf9-4b75-a167-10335fc2067c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:44.902043 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef489b4d-bbf9-4b75-a167-10335fc2067c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:44.903693 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 807/1646] 10.222.0.61 () {54 vars in 912 bytes} [Tue Apr 12 14:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:25:44.922357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8e6c0-b1cd-4efb-b271-be175f05a202 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:44.922926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8e6c0-b1cd-4efb-b271-be175f05a202 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:44.923936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8e6c0-b1cd-4efb-b271-be175f05a202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:45.042313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fce8e6c0-b1cd-4efb-b271-be175f05a202 None None] MFA Rules not processed for user `fa7ee0856f4644c994c3ccbd400b6fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:45.042313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fce8e6c0-b1cd-4efb-b271-be175f05a202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:45.189096 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 840/1647] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:25:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:45.266837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef489b4d-bbf9-4b75-a167-10335fc2067c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:45.285117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef489b4d-bbf9-4b75-a167-10335fc2067c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:45.290021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a32030-a10b-44b5-9c2c-f7f603846b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:45.290682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32030-a10b-44b5-9c2c-f7f603846b28 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:45.290967 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32030-a10b-44b5-9c2c-f7f603846b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:45.291246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32030-a10b-44b5-9c2c-f7f603846b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:45.301339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a32030-a10b-44b5-9c2c-f7f603846b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:45.302877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a32030-a10b-44b5-9c2c-f7f603846b28 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:45.317182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 808/1648] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:45.968520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8e6c0-b1cd-4efb-b271-be175f05a202 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:45.979368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8e6c0-b1cd-4efb-b271-be175f05a202 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:45.989090 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0fb94-a15d-4e86-a087-6b7cffc6f5a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:45.998367 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0fb94-a15d-4e86-a087-6b7cffc6f5a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:45.998367 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0fb94-a15d-4e86-a087-6b7cffc6f5a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:45.998367 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0fb94-a15d-4e86-a087-6b7cffc6f5a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:46.143660 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0fb94-a15d-4e86-a087-6b7cffc6f5a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:46.152683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0fb94-a15d-4e86-a087-6b7cffc6f5a2 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:46.191270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 841/1649] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:46.531378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627709-6ee3-482b-a56c-09ab2659d89d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:46.531921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627709-6ee3-482b-a56c-09ab2659d89d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:46.531921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627709-6ee3-482b-a56c-09ab2659d89d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:46.791230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 809/1650] 10.222.0.61 () {54 vars in 960 bytes} [Tue Apr 12 14:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:25:46.795209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a832b-7659-4dd9-9e22-3f0bb987bef7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:46.795209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a832b-7659-4dd9-9e22-3f0bb987bef7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:46.795209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a832b-7659-4dd9-9e22-3f0bb987bef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:46.795209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ef0a832b-7659-4dd9-9e22-3f0bb987bef7 None None] MFA Rules not processed for user `3a7095f3ab8545c589d4d28a846ba1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:46.795209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ef0a832b-7659-4dd9-9e22-3f0bb987bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:46.795209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 842/1651] 10.222.0.61 () {58 vars in 1057 bytes} [Tue Apr 12 14:25:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:46.804201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00627709-6ee3-482b-a56c-09ab2659d89d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:46.804201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00627709-6ee3-482b-a56c-09ab2659d89d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:46.804201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc62dad-5b0e-494c-a991-5713e9723009 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7095f3ab8545c589d4d28a846ba1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:46.804201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc62dad-5b0e-494c-a991-5713e9723009 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:46.807690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc62dad-5b0e-494c-a991-5713e9723009 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:46.807690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc62dad-5b0e-494c-a991-5713e9723009 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:46.807690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cfc62dad-5b0e-494c-a991-5713e9723009 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:46.839759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc62dad-5b0e-494c-a991-5713e9723009 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:46.851256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc62dad-5b0e-494c-a991-5713e9723009 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:46.890760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 810/1652] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:50.040202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a832b-7659-4dd9-9e22-3f0bb987bef7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:50.240058 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a832b-7659-4dd9-9e22-3f0bb987bef7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:50.251436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:50.252381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:50.252662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:50.252987 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] PATH_INFO: `/v3/users/09c78f8e913942e2826716f4679a2046` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:50.259452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c78f8e913942e2826716f4679a2046)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:50.263789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:50.583953 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c78f8e913942e2826716f4679a2046'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:50.613527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c78f8e913942e2826716f4679a2046'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:50.730443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c78f8e913942e2826716f4679a2046'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:50.740318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c78f8e913942e2826716f4679a2046'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:50.741376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c78f8e913942e2826716f4679a2046'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:50.772005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 843/1653] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:25:50 2022] DELETE /identity/v3/users/09c78f8e913942e2826716f4679a2046 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:50.778369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d9b29-fea6-4b48-a1d9-426288bfb914 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:50.778894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d9b29-fea6-4b48-a1d9-426288bfb914 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:50.778894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d9b29-fea6-4b48-a1d9-426288bfb914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:50.832788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cd4d9b29-fea6-4b48-a1d9-426288bfb914 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:50.838508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cd4d9b29-fea6-4b48-a1d9-426288bfb914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:51.042765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 811/1654] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:51.056858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:51.062364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:51.191977 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fad43-8cfd-4ec6-8137-7075fa133e81 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:51.202844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a04cc-119c-4133-85a3-ef4130630aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:51.203843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a04cc-119c-4133-85a3-ef4130630aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:51.204683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a04cc-119c-4133-85a3-ef4130630aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:51.205355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a04cc-119c-4133-85a3-ef4130630aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:51.223720 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a4b5-6c5a-494a-8659-85723b45d55a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:51.224004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a4b5-6c5a-494a-8659-85723b45d55a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:51.224282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a4b5-6c5a-494a-8659-85723b45d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:51.242208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a04cc-119c-4133-85a3-ef4130630aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:51.246032 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a04cc-119c-4133-85a3-ef4130630aa1 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:51.281207 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 844/1655] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:51.304743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b412a4b5-6c5a-494a-8659-85723b45d55a None None] MFA Rules not processed for user `6388423ccb4f44a0981a8b994fd222ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:51.306747 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b412a4b5-6c5a-494a-8659-85723b45d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:51.499321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 812/1656] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:25:51.538682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a04cc-119c-4133-85a3-ef4130630aa1 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:51.542664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-383a04cc-119c-4133-85a3-ef4130630aa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:51.725824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a04cc-119c-4133-85a3-ef4130630aa1 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:51.733832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4efeac-5a39-436e-a3ce-5ebcd90bf988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:51.734691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4efeac-5a39-436e-a3ce-5ebcd90bf988 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:51.735081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4efeac-5a39-436e-a3ce-5ebcd90bf988 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:51.735454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4efeac-5a39-436e-a3ce-5ebcd90bf988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:51.751777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4efeac-5a39-436e-a3ce-5ebcd90bf988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:51.755785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4efeac-5a39-436e-a3ce-5ebcd90bf988 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:51.767335 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 845/1657] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:52.885979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d6d4-07df-48d9-9955-4fbf2d7122bd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:52.891222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d6d4-07df-48d9-9955-4fbf2d7122bd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:52.891828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d6d4-07df-48d9-9955-4fbf2d7122bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:52.951219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-57d0d6d4-07df-48d9-9955-4fbf2d7122bd None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:52.953149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-57d0d6d4-07df-48d9-9955-4fbf2d7122bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:53.136225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 813/1658] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:25:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:53.292824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb2cd4-7a35-4329-b8a3-4f23dfe5acc0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:53.293406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb2cd4-7a35-4329-b8a3-4f23dfe5acc0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:53.293913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb2cd4-7a35-4329-b8a3-4f23dfe5acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:53.359524 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d6d4-07df-48d9-9955-4fbf2d7122bd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:53.361376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-57d0d6d4-07df-48d9-9955-4fbf2d7122bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:53.404835 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4adb2cd4-7a35-4329-b8a3-4f23dfe5acc0 None None] MFA Rules not processed for user `764047899a7f46569e12e14dda41b30d`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:53.408748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d6d4-07df-48d9-9955-4fbf2d7122bd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:53.412658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4adb2cd4-7a35-4329-b8a3-4f23dfe5acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:53.428387 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:53.429653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:53.432051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:53.433272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] PATH_INFO: `/v3/users/53383037f8b94098a9d1b72151ca63fb` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:53.438161 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53383037f8b94098a9d1b72151ca63fb)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:53.442813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:25:53.442813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Apr 12 14:25:53.442813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: Apr 12 14:25:53.448891 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:53.615014 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 846/1659] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:53.632421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb2cd4-7a35-4329-b8a3-4f23dfe5acc0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:53.634062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4adb2cd4-7a35-4329-b8a3-4f23dfe5acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:53.667055 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb2cd4-7a35-4329-b8a3-4f23dfe5acc0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:53.685093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6005c6-1073-4960-b4bb-22e79411f3cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:53.688776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6005c6-1073-4960-b4bb-22e79411f3cb service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:53.689720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6005c6-1073-4960-b4bb-22e79411f3cb service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:53.690916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6005c6-1073-4960-b4bb-22e79411f3cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:53.730523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6005c6-1073-4960-b4bb-22e79411f3cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:53.732439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6005c6-1073-4960-b4bb-22e79411f3cb service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:53.754716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 847/1660] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:25:53.755814 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6005c6-1073-4960-b4bb-22e79411f3cb service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:53.758710 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fb6005c6-1073-4960-b4bb-22e79411f3cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:53.884184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53383037f8b94098a9d1b72151ca63fb'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:53.922903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53383037f8b94098a9d1b72151ca63fb'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:53.924046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53383037f8b94098a9d1b72151ca63fb'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:53.940017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53383037f8b94098a9d1b72151ca63fb'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:53.941663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53383037f8b94098a9d1b72151ca63fb'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:53.976419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6005c6-1073-4960-b4bb-22e79411f3cb service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:53.983073 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee4a8b-bd95-4523-b2ef-c823b7c37273 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:53.983791 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4a8b-bd95-4523-b2ef-c823b7c37273 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:53.984080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4a8b-bd95-4523-b2ef-c823b7c37273 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:53.984385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4a8b-bd95-4523-b2ef-c823b7c37273 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:53.987777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-18ee4a8b-bd95-4523-b2ef-c823b7c37273 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:54.002842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee4a8b-bd95-4523-b2ef-c823b7c37273 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:54.004484 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee4a8b-bd95-4523-b2ef-c823b7c37273 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:54.015843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 848/1661] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:25:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:25:54.069446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 814/1662] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:25:53 2022] DELETE /identity/v3/users/53383037f8b94098a9d1b72151ca63fb => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:54.074897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbfed0-0d7c-4110-b287-acb2c5f69a0d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:54.075343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbfed0-0d7c-4110-b287-acb2c5f69a0d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:54.075628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbfed0-0d7c-4110-b287-acb2c5f69a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:54.142140 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:54.144218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:54.200310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d0fbfed0-0d7c-4110-b287-acb2c5f69a0d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:54.211430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d0fbfed0-0d7c-4110-b287-acb2c5f69a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:54.395241 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 849/1663] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:54.448819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a832a-fd22-4ce5-810a-7aecf8800dc7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:54.473913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd0067-b9ea-4893-8aa5-3e17607b5340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:54.474600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd0067-b9ea-4893-8aa5-3e17607b5340 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:54.474838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbfed0-0d7c-4110-b287-acb2c5f69a0d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:54.474944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd0067-b9ea-4893-8aa5-3e17607b5340 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:54.475133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd0067-b9ea-4893-8aa5-3e17607b5340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:54.480636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d0fbfed0-0d7c-4110-b287-acb2c5f69a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:54.488134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8acd0067-b9ea-4893-8aa5-3e17607b5340 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:54.709045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbfed0-0d7c-4110-b287-acb2c5f69a0d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:54.719376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0457e1f-4aa3-41e8-8148-67ea19923d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:54.719376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0457e1f-4aa3-41e8-8148-67ea19923d13 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:54.719376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0457e1f-4aa3-41e8-8148-67ea19923d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:54.719677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0457e1f-4aa3-41e8-8148-67ea19923d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:54.740522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0457e1f-4aa3-41e8-8148-67ea19923d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:54.742043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0457e1f-4aa3-41e8-8148-67ea19923d13 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:54.777610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 850/1664] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:54.830792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd0067-b9ea-4893-8aa5-3e17607b5340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:54.832224 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd0067-b9ea-4893-8aa5-3e17607b5340 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:54.955073 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 815/1665] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 812 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:56.121569 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0457e1f-4aa3-41e8-8148-67ea19923d13 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:56.123512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0457e1f-4aa3-41e8-8148-67ea19923d13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:56.148802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0457e1f-4aa3-41e8-8148-67ea19923d13 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:56.194644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:56.195648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:56.197822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:56.198879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] PATH_INFO: `/v3/projects/764d5a64c9da4da5b783275fc596b8cf` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:56.204296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=764d5a64c9da4da5b783275fc596b8cf)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:56.206885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:25:56.206885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Apr 12 14:25:56.206885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: Apr 12 14:25:56.211407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:56.514447 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd0067-b9ea-4893-8aa5-3e17607b5340 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:56.516204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8acd0067-b9ea-4893-8aa5-3e17607b5340 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:56.548373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd0067-b9ea-4893-8aa5-3e17607b5340 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:56.651415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:56.652558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:56.653180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:56.659664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] PATH_INFO: `/v3/projects/552466e02aac41228c5d9e25ad672187` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:56.659664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=552466e02aac41228c5d9e25ad672187)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:56.659664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:56.677742 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764d5a64c9da4da5b783275fc596b8cf', 'request_id': 'req-fe62b55c-701c-48b2-8a59-d591243fefd0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:56.813718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764d5a64c9da4da5b783275fc596b8cf', 'request_id': 'req-fe62b55c-701c-48b2-8a59-d591243fefd0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:56.844990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764d5a64c9da4da5b783275fc596b8cf', 'request_id': 'req-fe62b55c-701c-48b2-8a59-d591243fefd0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:56.883218 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] The token cache is being invalidate because project 764d5a64c9da4da5b783275fc596b8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:25:56.883772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:56.884785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fe62b55c-701c-48b2-8a59-d591243fefd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:56.891680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 851/1666] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:25:56 2022] DELETE /identity/v3/projects/764d5a64c9da4da5b783275fc596b8cf => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:56.896905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d9c6-e134-4b35-a210-576489d284c8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:56.896905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d9c6-e134-4b35-a210-576489d284c8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:56.896905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d9c6-e134-4b35-a210-576489d284c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:56.909939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552466e02aac41228c5d9e25ad672187', 'request_id': 'req-a3473854-8273-4fa7-88e2-636e2695bd0f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:56.938043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-88f3d9c6-e134-4b35-a210-576489d284c8 None None] MFA Rules not processed for user `fa7ee0856f4644c994c3ccbd400b6fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:56.940745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-88f3d9c6-e134-4b35-a210-576489d284c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:57.055304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552466e02aac41228c5d9e25ad672187', 'request_id': 'req-a3473854-8273-4fa7-88e2-636e2695bd0f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:57.056258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 852/1667] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Apr 12 14:25:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:57.058348 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb91d-cb57-4935-9381-674f18135549 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:57.071274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb91d-cb57-4935-9381-674f18135549 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:57.071274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb91d-cb57-4935-9381-674f18135549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:57.082371 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552466e02aac41228c5d9e25ad672187', 'request_id': 'req-a3473854-8273-4fa7-88e2-636e2695bd0f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:57.101388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] The token cache is being invalidate because project 552466e02aac41228c5d9e25ad672187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:25:57.101826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:57.103049 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:57.111797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 816/1668] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:25:56 2022] DELETE /identity/v3/projects/552466e02aac41228c5d9e25ad672187 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:57.111797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:57.116287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:57.143052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3cabb91d-cb57-4935-9381-674f18135549 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:57.144290 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3cabb91d-cb57-4935-9381-674f18135549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:57.150681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3473854-8273-4fa7-88e2-636e2695bd0f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:57.158825 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a81fc-abef-4a35-a38b-1bed7a77ff0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:57.182721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a81fc-abef-4a35-a38b-1bed7a77ff0b service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:57.182721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a81fc-abef-4a35-a38b-1bed7a77ff0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:57.182721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a81fc-abef-4a35-a38b-1bed7a77ff0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:57.182721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-009a81fc-abef-4a35-a38b-1bed7a77ff0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:57.182721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a81fc-abef-4a35-a38b-1bed7a77ff0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:57.182721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a81fc-abef-4a35-a38b-1bed7a77ff0b service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:57.204230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 817/1669] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:57.212322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef90ea-3e24-46da-b3ed-2b867745dffc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:57.215570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef90ea-3e24-46da-b3ed-2b867745dffc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:57.215901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef90ea-3e24-46da-b3ed-2b867745dffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:57.264080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f7ef90ea-3e24-46da-b3ed-2b867745dffc None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:57.265413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f7ef90ea-3e24-46da-b3ed-2b867745dffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:57.377315 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 853/1670] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:57.380866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabb91d-cb57-4935-9381-674f18135549 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:57.384682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3cabb91d-cb57-4935-9381-674f18135549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:57.427908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabb91d-cb57-4935-9381-674f18135549 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:57.459451 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:57.463417 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:57.465350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:57.468418 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] PATH_INFO: `/v3/users/8459b0ded67a4812955eb69f3f28be64` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:57.474917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8459b0ded67a4812955eb69f3f28be64)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:57.493369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 818/1671] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:57.493369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d630c0-c4ab-4d95-a912-3f866d7e31e1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:57.493369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d630c0-c4ab-4d95-a912-3f866d7e31e1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:57.493369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d630c0-c4ab-4d95-a912-3f866d7e31e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:57.493718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:57.543664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-90d630c0-c4ab-4d95-a912-3f866d7e31e1 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:57.548754 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-90d630c0-c4ab-4d95-a912-3f866d7e31e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:57.573808 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 819/1672] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:57.577489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb771a59-feb7-4aea-a9ee-7e122db47816 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:57.579262 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb771a59-feb7-4aea-a9ee-7e122db47816 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:57.579838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb771a59-feb7-4aea-a9ee-7e122db47816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:57.688611 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-eb771a59-feb7-4aea-a9ee-7e122db47816 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:57.691801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-eb771a59-feb7-4aea-a9ee-7e122db47816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:57.730575 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 820/1673] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:57.731908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb771a59-feb7-4aea-a9ee-7e122db47816 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:57.778075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb771a59-feb7-4aea-a9ee-7e122db47816 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:57.796398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8459b0ded67a4812955eb69f3f28be64'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:57.798261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e7db5-e807-4442-ad4c-13e4ef83a096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:57.799079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e7db5-e807-4442-ad4c-13e4ef83a096 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:57.800597 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e7db5-e807-4442-ad4c-13e4ef83a096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:57.803768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e7db5-e807-4442-ad4c-13e4ef83a096 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:57.804865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e7db5-e807-4442-ad4c-13e4ef83a096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:25:57.807223 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e7db5-e807-4442-ad4c-13e4ef83a096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:57.811020 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e7db5-e807-4442-ad4c-13e4ef83a096 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:57.839587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8459b0ded67a4812955eb69f3f28be64'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:57.899177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 821/1674] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:25:57.899177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e7db5-e807-4442-ad4c-13e4ef83a096 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:57.920466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e7db5-e807-4442-ad4c-13e4ef83a096 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:57.936859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729d4df-59f3-4d52-a472-f375034569d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:57.937844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729d4df-59f3-4d52-a472-f375034569d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:57.938360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729d4df-59f3-4d52-a472-f375034569d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:57.938641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729d4df-59f3-4d52-a472-f375034569d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:57.939721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729d4df-59f3-4d52-a472-f375034569d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:25:57.940033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729d4df-59f3-4d52-a472-f375034569d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:57.944830 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729d4df-59f3-4d52-a472-f375034569d8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:57.945622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8459b0ded67a4812955eb69f3f28be64'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:57.964744 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8459b0ded67a4812955eb69f3f28be64'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:57.968627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8459b0ded67a4812955eb69f3f28be64'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:25:57.976976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 822/1675] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:25:57.978202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729d4df-59f3-4d52-a472-f375034569d8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:57.980279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8729d4df-59f3-4d52-a472-f375034569d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:57.994992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729d4df-59f3-4d52-a472-f375034569d8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:58.002059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd09cfc-b220-41f6-8fcc-b97d0725ab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:58.003095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd09cfc-b220-41f6-8fcc-b97d0725ab57 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:58.003561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd09cfc-b220-41f6-8fcc-b97d0725ab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:58.004044 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd09cfc-b220-41f6-8fcc-b97d0725ab57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:58.005145 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd09cfc-b220-41f6-8fcc-b97d0725ab57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:58.007006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 854/1676] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:25:57 2022] DELETE /identity/v3/users/8459b0ded67a4812955eb69f3f28be64 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:58.007125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd09cfc-b220-41f6-8fcc-b97d0725ab57 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:58.009519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:58.015852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:58.176305 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 823/1677] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:57 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:58.181108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c095c11-4525-4105-92b9-529a1f3ab481 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:58.181469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c095c11-4525-4105-92b9-529a1f3ab481 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:58.183125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c095c11-4525-4105-92b9-529a1f3ab481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:58.188216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86565-fa2b-4fe7-9a6b-47ef18b4d37c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:58.260851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3c095c11-4525-4105-92b9-529a1f3ab481 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:58.267836 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3c095c11-4525-4105-92b9-529a1f3ab481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:58.417325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49612892-1e4f-4377-91e9-0df03f28c611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:58.417325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49612892-1e4f-4377-91e9-0df03f28c611 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:58.417325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49612892-1e4f-4377-91e9-0df03f28c611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:58.417816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49612892-1e4f-4377-91e9-0df03f28c611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:58.418633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49612892-1e4f-4377-91e9-0df03f28c611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:58.445947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49612892-1e4f-4377-91e9-0df03f28c611 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:58.594000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 824/1678] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:25:58.595955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c095c11-4525-4105-92b9-529a1f3ab481 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:58.639275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c095c11-4525-4105-92b9-529a1f3ab481 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:58.655613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b20555-29e8-4a0d-9412-4c05d9086ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:58.659620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b20555-29e8-4a0d-9412-4c05d9086ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:58.659620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b20555-29e8-4a0d-9412-4c05d9086ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:58.659620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b20555-29e8-4a0d-9412-4c05d9086ddc admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:58.684092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b20555-29e8-4a0d-9412-4c05d9086ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:58.695519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b20555-29e8-4a0d-9412-4c05d9086ddc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:58.714069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 855/1679] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:25:58 2022] POST /identity/v3/projects => generated 405 bytes in 706 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:58.719078 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49612892-1e4f-4377-91e9-0df03f28c611 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:58.726084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-49612892-1e4f-4377-91e9-0df03f28c611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:58.834601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 825/1680] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:58 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:58.835844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b20555-29e8-4a0d-9412-4c05d9086ddc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:58.874737 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b20555-29e8-4a0d-9412-4c05d9086ddc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:59.001079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3daab-3f0a-4df2-a652-1c1f569688bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:59.003853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3daab-3f0a-4df2-a652-1c1f569688bd admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:59.004860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3daab-3f0a-4df2-a652-1c1f569688bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:59.005497 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3daab-3f0a-4df2-a652-1c1f569688bd admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:59.006863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3daab-3f0a-4df2-a652-1c1f569688bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:59.009455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3daab-3f0a-4df2-a652-1c1f569688bd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:59.082513 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49612892-1e4f-4377-91e9-0df03f28c611 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:59.108257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8a909-05d4-43dc-a7ab-588e12015d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:59.109243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8a909-05d4-43dc-a7ab-588e12015d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:59.109974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8a909-05d4-43dc-a7ab-588e12015d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:59.110110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8a909-05d4-43dc-a7ab-588e12015d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:59.149822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 826/1681] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:25:58 2022] POST /identity/v3/users => generated 303 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:25:59.150902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3daab-3f0a-4df2-a652-1c1f569688bd admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:59.159687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8a909-05d4-43dc-a7ab-588e12015d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:59.162016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8a909-05d4-43dc-a7ab-588e12015d23 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:59.192910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3daab-3f0a-4df2-a652-1c1f569688bd admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:59.209306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30da39d-d49d-4dd9-83da-17227b94d0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:59.211662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30da39d-d49d-4dd9-83da-17227b94d0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:59.212072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30da39d-d49d-4dd9-83da-17227b94d0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:59.213571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30da39d-d49d-4dd9-83da-17227b94d0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:59.217915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30da39d-d49d-4dd9-83da-17227b94d0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:59.220590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 856/1682] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:25:59.221950 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8a909-05d4-43dc-a7ab-588e12015d23 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:59.222797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30da39d-d49d-4dd9-83da-17227b94d0d0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:59.254096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 827/1683] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:59.258564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8a909-05d4-43dc-a7ab-588e12015d23 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:59.259950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30da39d-d49d-4dd9-83da-17227b94d0d0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:59.275273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a1be6-89d9-4acd-9173-5866d61d0c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:59.276618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a1be6-89d9-4acd-9173-5866d61d0c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:59.277757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a1be6-89d9-4acd-9173-5866d61d0c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:59.289377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a1be6-89d9-4acd-9173-5866d61d0c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:59.289377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a1be6-89d9-4acd-9173-5866d61d0c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:59.289377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a1be6-89d9-4acd-9173-5866d61d0c15 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:59.289654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30da39d-d49d-4dd9-83da-17227b94d0d0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:59.323201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fe212-2be2-48e2-87ca-43e8accc89c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:59.326356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fe212-2be2-48e2-87ca-43e8accc89c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:59.326844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fe212-2be2-48e2-87ca-43e8accc89c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:59.327138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fe212-2be2-48e2-87ca-43e8accc89c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:59.334257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fe212-2be2-48e2-87ca-43e8accc89c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:59.336141 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 857/1684] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:59.337486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a1be6-89d9-4acd-9173-5866d61d0c15 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:59.341557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fe212-2be2-48e2-87ca-43e8accc89c7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:59.394528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a1be6-89d9-4acd-9173-5866d61d0c15 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:59.418599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 828/1685] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:59.433949 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fe212-2be2-48e2-87ca-43e8accc89c7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:59.443951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe8a0e-6630-40a5-8cc6-ee692b9423d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:59.445255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe8a0e-6630-40a5-8cc6-ee692b9423d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:59.448293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe8a0e-6630-40a5-8cc6-ee692b9423d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:59.450379 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe8a0e-6630-40a5-8cc6-ee692b9423d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:59.456842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe8a0e-6630-40a5-8cc6-ee692b9423d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:59.469756 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe8a0e-6630-40a5-8cc6-ee692b9423d9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:59.486949 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fe212-2be2-48e2-87ca-43e8accc89c7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:59.500739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d865e3-a3b3-4aec-905d-7a30d4b4dc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:59.501863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d865e3-a3b3-4aec-905d-7a30d4b4dc7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:59.502301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d865e3-a3b3-4aec-905d-7a30d4b4dc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:59.502674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d865e3-a3b3-4aec-905d-7a30d4b4dc7f admin admin] PATH_INFO: `/v3/projects/57c4d3e6a0444576bfb2c4e6baf86c7b/users/86b3b1e9f1324eaa928f2f3ca9720ae9/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:59.524822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d865e3-a3b3-4aec-905d-7a30d4b4dc7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c4d3e6a0444576bfb2c4e6baf86c7b, user_id=86b3b1e9f1324eaa928f2f3ca9720ae9, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:59.531121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d865e3-a3b3-4aec-905d-7a30d4b4dc7f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:59.533100 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 858/1686] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:25:59.559680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe8a0e-6630-40a5-8cc6-ee692b9423d9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:25:59.584655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe8a0e-6630-40a5-8cc6-ee692b9423d9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:25:59.593287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c9f3d-7bb8-438c-ab46-5ab75d84e3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:25:59.594722 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c9f3d-7bb8-438c-ab46-5ab75d84e3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:59.595192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c9f3d-7bb8-438c-ab46-5ab75d84e3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:59.597021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c9f3d-7bb8-438c-ab46-5ab75d84e3d0 admin admin] PATH_INFO: `/v3/projects/eb1945a000d7427cb02f474de9c2f366/users/20eddc1ca4da4c5bb14566507963c629/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:59.652022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c9f3d-7bb8-438c-ab46-5ab75d84e3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1945a000d7427cb02f474de9c2f366, user_id=20eddc1ca4da4c5bb14566507963c629, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:25:59.655519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c9f3d-7bb8-438c-ab46-5ab75d84e3d0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:25:59.680669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 829/1687] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:59 2022] PUT /identity/v3/projects/57c4d3e6a0444576bfb2c4e6baf86c7b/users/86b3b1e9f1324eaa928f2f3ca9720ae9/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:59.692862 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed114e-1272-45cc-9b77-96c0cd1fecef None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:59.693522 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed114e-1272-45cc-9b77-96c0cd1fecef None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:59.694019 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed114e-1272-45cc-9b77-96c0cd1fecef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:59.766132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 859/1688] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:25:59 2022] PUT /identity/v3/projects/eb1945a000d7427cb02f474de9c2f366/users/20eddc1ca4da4c5bb14566507963c629/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:25:59.780601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-17ed114e-1272-45cc-9b77-96c0cd1fecef None None] MFA Rules not processed for user `86b3b1e9f1324eaa928f2f3ca9720ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:59.781289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2f02-c674-4c01-a006-7598db9316f1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:25:59.781717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2f02-c674-4c01-a006-7598db9316f1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:25:59.781912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-17ed114e-1272-45cc-9b77-96c0cd1fecef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:25:59.782393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2f02-c674-4c01-a006-7598db9316f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:25:59.840817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3d4a2f02-c674-4c01-a006-7598db9316f1 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:25:59.844849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3d4a2f02-c674-4c01-a006-7598db9316f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:00.080055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 830/1689] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:00.086061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed114e-1272-45cc-9b77-96c0cd1fecef None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:00.135880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 860/1690] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:00.149972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a231171-54f8-44cd-9777-05fd52ab3310 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:00.150270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a231171-54f8-44cd-9777-05fd52ab3310 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:00.150608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a231171-54f8-44cd-9777-05fd52ab3310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:00.239237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8a231171-54f8-44cd-9777-05fd52ab3310 None None] MFA Rules not processed for user `ceb69d85e1f24983aa9de1557e468494`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:00.241493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8a231171-54f8-44cd-9777-05fd52ab3310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:00.286254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed114e-1272-45cc-9b77-96c0cd1fecef None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:00.304087 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123a698-4eb6-4d41-98b2-9d654cc1719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:00.307109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a698-4eb6-4d41-98b2-9d654cc1719b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:00.307633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a698-4eb6-4d41-98b2-9d654cc1719b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:00.308118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a698-4eb6-4d41-98b2-9d654cc1719b admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:00.309058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123a698-4eb6-4d41-98b2-9d654cc1719b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:00.312018 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123a698-4eb6-4d41-98b2-9d654cc1719b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:00.458320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 831/1691] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:00 2022] POST /identity/v3/projects => generated 373 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:00.459541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123a698-4eb6-4d41-98b2-9d654cc1719b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:00.527806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 861/1692] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:00.531243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a231171-54f8-44cd-9777-05fd52ab3310 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:00.559483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a231171-54f8-44cd-9777-05fd52ab3310 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:00.642911 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123a698-4eb6-4d41-98b2-9d654cc1719b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:00.665446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c28df0-a9e6-43fc-9cfc-1486c18d5acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:00.666560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c28df0-a9e6-43fc-9cfc-1486c18d5acb service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:00.667086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c28df0-a9e6-43fc-9cfc-1486c18d5acb service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:00.667522 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c28df0-a9e6-43fc-9cfc-1486c18d5acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:00.763574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61a2e-eb7e-4196-bd72-e901517229c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:00.765994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61a2e-eb7e-4196-bd72-e901517229c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:00.766238 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61a2e-eb7e-4196-bd72-e901517229c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:00.766525 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61a2e-eb7e-4196-bd72-e901517229c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:00.767381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e61a2e-eb7e-4196-bd72-e901517229c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:00.784571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e61a2e-eb7e-4196-bd72-e901517229c2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:00.861898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c28df0-a9e6-43fc-9cfc-1486c18d5acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:00.864784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c28df0-a9e6-43fc-9cfc-1486c18d5acb service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:00.890149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 832/1693] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:00.894954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80322839-83ec-4f2b-91e4-7d470ad1b218 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:00.894954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80322839-83ec-4f2b-91e4-7d470ad1b218 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:00.894954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80322839-83ec-4f2b-91e4-7d470ad1b218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:00.945772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-80322839-83ec-4f2b-91e4-7d470ad1b218 None None] MFA Rules not processed for user `ceb69d85e1f24983aa9de1557e468494`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:00.948207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-80322839-83ec-4f2b-91e4-7d470ad1b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:00.973069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 862/1694] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:00 2022] POST /identity/v3/users => generated 293 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:00.974419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61a2e-eb7e-4196-bd72-e901517229c2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:01.005097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61a2e-eb7e-4196-bd72-e901517229c2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:01.030468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e286f-e9ee-4005-ab15-eeb6ea4c57b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:01.033271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e286f-e9ee-4005-ab15-eeb6ea4c57b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:01.033271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e286f-e9ee-4005-ab15-eeb6ea4c57b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:01.033271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e286f-e9ee-4005-ab15-eeb6ea4c57b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:01.034039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e286f-e9ee-4005-ab15-eeb6ea4c57b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:01.041920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e286f-e9ee-4005-ab15-eeb6ea4c57b6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:01.062704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 863/1695] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:01.070027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e286f-e9ee-4005-ab15-eeb6ea4c57b6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:01.094563 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e286f-e9ee-4005-ab15-eeb6ea4c57b6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:01.097051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 833/1696] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:01.110268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34e42d-c0c9-4a03-930b-f43523d9868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:01.111654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34e42d-c0c9-4a03-930b-f43523d9868f admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:01.112159 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34e42d-c0c9-4a03-930b-f43523d9868f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:01.112808 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34e42d-c0c9-4a03-930b-f43523d9868f admin admin] PATH_INFO: `/v3/projects/6448248615ce4e7eb3a4bdde276bcb84/users/d1ec92cc7cf04efa9222a72529dae56f/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:01.112911 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80322839-83ec-4f2b-91e4-7d470ad1b218 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:01.114875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-80322839-83ec-4f2b-91e4-7d470ad1b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:01.134278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34e42d-c0c9-4a03-930b-f43523d9868f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6448248615ce4e7eb3a4bdde276bcb84, user_id=d1ec92cc7cf04efa9222a72529dae56f, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:01.137501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34e42d-c0c9-4a03-930b-f43523d9868f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:01.256900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 864/1697] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:01 2022] PUT /identity/v3/projects/6448248615ce4e7eb3a4bdde276bcb84/users/d1ec92cc7cf04efa9222a72529dae56f/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:01.263901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34e42d-c0c9-4a03-930b-f43523d9868f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:01.347215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80322839-83ec-4f2b-91e4-7d470ad1b218 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:01.444314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34e42d-c0c9-4a03-930b-f43523d9868f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:01.460879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd4f4c-ea07-422c-9972-8f5aba994b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:01.465133 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd4f4c-ea07-422c-9972-8f5aba994b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:01.465976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd4f4c-ea07-422c-9972-8f5aba994b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:01.467494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd4f4c-ea07-422c-9972-8f5aba994b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:01.479528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd4f4c-ea07-422c-9972-8f5aba994b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:01.481467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd4f4c-ea07-422c-9972-8f5aba994b48 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:01.523488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 865/1698] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:01.524794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd4f4c-ea07-422c-9972-8f5aba994b48 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:01.557992 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd4f4c-ea07-422c-9972-8f5aba994b48 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:01.565980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881a06f-8f3f-44e0-aed4-c5468d2aaeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:01.567264 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881a06f-8f3f-44e0-aed4-c5468d2aaeed admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:01.567557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881a06f-8f3f-44e0-aed4-c5468d2aaeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:01.568081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881a06f-8f3f-44e0-aed4-c5468d2aaeed admin admin] PATH_INFO: `/v3/projects/6448248615ce4e7eb3a4bdde276bcb84/users/d1ec92cc7cf04efa9222a72529dae56f/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:01.571829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881a06f-8f3f-44e0-aed4-c5468d2aaeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=6448248615ce4e7eb3a4bdde276bcb84, user_id=d1ec92cc7cf04efa9222a72529dae56f, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:01.572877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9a2e9-5ee8-4cba-96fb-310e7df7f186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:01.573895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9a2e9-5ee8-4cba-96fb-310e7df7f186 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:01.574426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9a2e9-5ee8-4cba-96fb-310e7df7f186 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:01.574984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9a2e9-5ee8-4cba-96fb-310e7df7f186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:01.586426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881a06f-8f3f-44e0-aed4-c5468d2aaeed admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:01.615216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 866/1699] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:01 2022] PUT /identity/v3/projects/6448248615ce4e7eb3a4bdde276bcb84/users/d1ec92cc7cf04efa9222a72529dae56f/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:01.620170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5739-40d0-4e03-b0b1-9eef7fa6d046 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:01.620461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5739-40d0-4e03-b0b1-9eef7fa6d046 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:01.620741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5739-40d0-4e03-b0b1-9eef7fa6d046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:01.718594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9a2e9-5ee8-4cba-96fb-310e7df7f186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:01.721858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9a2e9-5ee8-4cba-96fb-310e7df7f186 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:01.752527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 834/1700] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:01.770069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-42ce5739-40d0-4e03-b0b1-9eef7fa6d046 None None] MFA Rules not processed for user `d1ec92cc7cf04efa9222a72529dae56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:01.774887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-42ce5739-40d0-4e03-b0b1-9eef7fa6d046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:01.995439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 867/1701] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:02.013870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9a2e9-5ee8-4cba-96fb-310e7df7f186 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:02.017629 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c2a9a2e9-5ee8-4cba-96fb-310e7df7f186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:02.214962 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9a2e9-5ee8-4cba-96fb-310e7df7f186 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:02.324135 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e03fc-dd35-429b-9cce-907d5bdbf46b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:02.324745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e03fc-dd35-429b-9cce-907d5bdbf46b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:02.324745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e03fc-dd35-429b-9cce-907d5bdbf46b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:02.327217 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 868/1702] 10.222.0.61 () {54 vars in 921 bytes} [Tue Apr 12 14:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:26:02.394455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8412bb-c605-4f01-961a-5dc7e65d9a03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:02.395129 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8412bb-c605-4f01-961a-5dc7e65d9a03 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:02.398332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8412bb-c605-4f01-961a-5dc7e65d9a03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:02.398332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8412bb-c605-4f01-961a-5dc7e65d9a03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:02.438568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8412bb-c605-4f01-961a-5dc7e65d9a03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:02.442516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4ddcd-d14b-41f2-8df4-903419435623 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:02.442809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4ddcd-d14b-41f2-8df4-903419435623 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:02.443143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4ddcd-d14b-41f2-8df4-903419435623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:02.448784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8412bb-c605-4f01-961a-5dc7e65d9a03 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:02.482210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-43b4ddcd-d14b-41f2-8df4-903419435623 None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:02.488109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-43b4ddcd-d14b-41f2-8df4-903419435623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:02.489313 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 835/1703] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:26:02.525004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8412bb-c605-4f01-961a-5dc7e65d9a03 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:02.526288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1d8412bb-c605-4f01-961a-5dc7e65d9a03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:02.694248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8412bb-c605-4f01-961a-5dc7e65d9a03 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:02.708279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:02.711376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:02.711662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:02.712172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] PATH_INFO: `/v3/projects/d8251f0508404f13b224cdc907726798` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:02.724334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8251f0508404f13b224cdc907726798)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:02.726411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 869/1704] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Apr 12 14:26:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:02.727330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4ddcd-d14b-41f2-8df4-903419435623 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:02.728955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-43b4ddcd-d14b-41f2-8df4-903419435623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:02.730734 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:02.765804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4ddcd-d14b-41f2-8df4-903419435623 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:02.782671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4a226-e2b1-436e-94c0-32413a6e57ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:02.784445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4a226-e2b1-436e-94c0-32413a6e57ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:02.784445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4a226-e2b1-436e-94c0-32413a6e57ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:02.784445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4a226-e2b1-436e-94c0-32413a6e57ec admin admin] PATH_INFO: `/v3/users/ef302e14eee14a7c9c05eeaa40cc1ed0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:02.786620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4a226-e2b1-436e-94c0-32413a6e57ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef302e14eee14a7c9c05eeaa40cc1ed0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:02.788595 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4a226-e2b1-436e-94c0-32413a6e57ec admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:02.970197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8251f0508404f13b224cdc907726798', 'request_id': 'req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:03.056456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8251f0508404f13b224cdc907726798', 'request_id': 'req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:03.065933 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8251f0508404f13b224cdc907726798', 'request_id': 'req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:03.146803 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-86e4a226-e2b1-436e-94c0-32413a6e57ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef302e14eee14a7c9c05eeaa40cc1ed0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:03.158235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] The token cache is being invalidate because project d8251f0508404f13b224cdc907726798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:03.158557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:03.165119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2ca52f0-6523-4b77-80b2-8e6058e51a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:03.172285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 836/1705] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:02 2022] DELETE /identity/v3/projects/d8251f0508404f13b224cdc907726798 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:03.176419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dcd4-d82a-4fa1-914c-5ae5c9dd33d6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:03.176419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dcd4-d82a-4fa1-914c-5ae5c9dd33d6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:03.176419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017dcd4-d82a-4fa1-914c-5ae5c9dd33d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:03.209085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-86e4a226-e2b1-436e-94c0-32413a6e57ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef302e14eee14a7c9c05eeaa40cc1ed0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:03.237978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c017dcd4-d82a-4fa1-914c-5ae5c9dd33d6 None None] MFA Rules not processed for user `6388423ccb4f44a0981a8b994fd222ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:03.240767 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c017dcd4-d82a-4fa1-914c-5ae5c9dd33d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:03.276108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-86e4a226-e2b1-436e-94c0-32413a6e57ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef302e14eee14a7c9c05eeaa40cc1ed0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:03.289302 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-86e4a226-e2b1-436e-94c0-32413a6e57ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef302e14eee14a7c9c05eeaa40cc1ed0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:03.290520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-86e4a226-e2b1-436e-94c0-32413a6e57ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef302e14eee14a7c9c05eeaa40cc1ed0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:03.311245 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 870/1706] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:02 2022] DELETE /identity/v3/users/ef302e14eee14a7c9c05eeaa40cc1ed0 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:03.317285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7de2b2-01ce-4d6f-b9b6-bac81b698407 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:03.317285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7de2b2-01ce-4d6f-b9b6-bac81b698407 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:03.317285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7de2b2-01ce-4d6f-b9b6-bac81b698407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:03.393209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ea7de2b2-01ce-4d6f-b9b6-bac81b698407 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:03.394189 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ea7de2b2-01ce-4d6f-b9b6-bac81b698407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:03.468050 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 837/1707] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:03.472411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cee71-a135-41c1-aee6-f2ff6300db54 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:03.472411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cee71-a135-41c1-aee6-f2ff6300db54 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:03.472656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cee71-a135-41c1-aee6-f2ff6300db54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:03.530396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-757cee71-a135-41c1-aee6-f2ff6300db54 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:03.536187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-757cee71-a135-41c1-aee6-f2ff6300db54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:03.626726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 871/1708] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:03.628583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ae33a-7929-4f54-9ffd-d9d02f11d096 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:03.632835 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ae33a-7929-4f54-9ffd-d9d02f11d096 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:03.634091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ae33a-7929-4f54-9ffd-d9d02f11d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:03.715446 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ad8ae33a-7929-4f54-9ffd-d9d02f11d096 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:03.723561 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ad8ae33a-7929-4f54-9ffd-d9d02f11d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:03.724544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 838/1709] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:03.741111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cee71-a135-41c1-aee6-f2ff6300db54 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:03.743115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-757cee71-a135-41c1-aee6-f2ff6300db54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:03.753799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 872/1710] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:03.764375 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ae33a-7929-4f54-9ffd-d9d02f11d096 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:03.792176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ae33a-7929-4f54-9ffd-d9d02f11d096 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:03.824060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8132e-31bd-48d4-b7d1-ad6592fd84c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:03.824924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8132e-31bd-48d4-b7d1-ad6592fd84c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:03.826022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8132e-31bd-48d4-b7d1-ad6592fd84c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:03.826435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8132e-31bd-48d4-b7d1-ad6592fd84c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:03.828216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8132e-31bd-48d4-b7d1-ad6592fd84c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:03.845817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8132e-31bd-48d4-b7d1-ad6592fd84c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:03.847868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8132e-31bd-48d4-b7d1-ad6592fd84c2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:03.878499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 873/1711] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:03.890446 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8132e-31bd-48d4-b7d1-ad6592fd84c2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:03.893240 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ef8132e-31bd-48d4-b7d1-ad6592fd84c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:04.026730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cee71-a135-41c1-aee6-f2ff6300db54 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:04.051363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ea658-6b44-4391-8868-3a14e62bc178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:04.052442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ea658-6b44-4391-8868-3a14e62bc178 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:04.052442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ea658-6b44-4391-8868-3a14e62bc178 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:04.052649 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ea658-6b44-4391-8868-3a14e62bc178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:04.062787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c47ea658-6b44-4391-8868-3a14e62bc178 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:04.078856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8132e-31bd-48d4-b7d1-ad6592fd84c2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:04.088726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbda2e-5b02-461c-bd3e-b5446a0c497c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:04.089508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbda2e-5b02-461c-bd3e-b5446a0c497c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:04.093822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbda2e-5b02-461c-bd3e-b5446a0c497c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:04.093822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbda2e-5b02-461c-bd3e-b5446a0c497c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:04.101407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ea658-6b44-4391-8868-3a14e62bc178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:04.111270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ea658-6b44-4391-8868-3a14e62bc178 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:04.124879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbda2e-5b02-461c-bd3e-b5446a0c497c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:04.126790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbda2e-5b02-461c-bd3e-b5446a0c497c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:04.157382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 839/1712] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:26:04.158276 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 874/1713] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:04.158422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ea658-6b44-4391-8868-3a14e62bc178 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:04.159877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42978a6e-5cc9-4861-8624-0159bb7b8f5a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:04.162014 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42978a6e-5cc9-4861-8624-0159bb7b8f5a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:04.162412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42978a6e-5cc9-4861-8624-0159bb7b8f5a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:04.171933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 875/1714] 10.222.0.61 () {54 vars in 912 bytes} [Tue Apr 12 14:26:04 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:26:04.175221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42978a6e-5cc9-4861-8624-0159bb7b8f5a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:04.180684 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-42978a6e-5cc9-4861-8624-0159bb7b8f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:04.194642 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ea658-6b44-4391-8868-3a14e62bc178 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:04.222900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5f72e-5fc6-4895-a86f-704ffab3ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:04.223586 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5f72e-5fc6-4895-a86f-704ffab3ddee admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:04.223890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5f72e-5fc6-4895-a86f-704ffab3ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:04.224168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5f72e-5fc6-4895-a86f-704ffab3ddee admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:04.224904 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5f72e-5fc6-4895-a86f-704ffab3ddee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:04.226901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5f72e-5fc6-4895-a86f-704ffab3ddee admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:04.227641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42978a6e-5cc9-4861-8624-0159bb7b8f5a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:04.251587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ee3a2-24b9-4b25-b7c4-22e230fb0b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:04.252736 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ee3a2-24b9-4b25-b7c4-22e230fb0b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:04.253183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ee3a2-24b9-4b25-b7c4-22e230fb0b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:04.253676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ee3a2-24b9-4b25-b7c4-22e230fb0b24 admin admin] PATH_INFO: `/v3/users/86b3b1e9f1324eaa928f2f3ca9720ae9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:04.255322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ee3a2-24b9-4b25-b7c4-22e230fb0b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b3b1e9f1324eaa928f2f3ca9720ae9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:04.257800 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ee3a2-24b9-4b25-b7c4-22e230fb0b24 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:04.384824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 840/1715] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:04 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:04.394378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e23546-c5b3-45e7-b4db-13b26478b40a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:04.396394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e23546-c5b3-45e7-b4db-13b26478b40a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:04.396394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e23546-c5b3-45e7-b4db-13b26478b40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:04.452637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-49e23546-c5b3-45e7-b4db-13b26478b40a None None] MFA Rules not processed for user `fa7ee0856f4644c994c3ccbd400b6fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:04.458384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-49e23546-c5b3-45e7-b4db-13b26478b40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:04.585482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 841/1716] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:26:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:04.586505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e23546-c5b3-45e7-b4db-13b26478b40a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:04.730827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e23546-c5b3-45e7-b4db-13b26478b40a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:04.760591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37aa9db-9a88-48ed-920a-5c272bb05a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:04.764056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aa9db-9a88-48ed-920a-5c272bb05a76 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:04.764727 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aa9db-9a88-48ed-920a-5c272bb05a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:04.765406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6e3ee3a2-24b9-4b25-b7c4-22e230fb0b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b3b1e9f1324eaa928f2f3ca9720ae9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:04.766348 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aa9db-9a88-48ed-920a-5c272bb05a76 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:04.768804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37aa9db-9a88-48ed-920a-5c272bb05a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:04.772354 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37aa9db-9a88-48ed-920a-5c272bb05a76 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:04.824806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6e3ee3a2-24b9-4b25-b7c4-22e230fb0b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b3b1e9f1324eaa928f2f3ca9720ae9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:04.931715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 842/1717] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:04 2022] POST /identity/v3/users => generated 293 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:04.932942 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37aa9db-9a88-48ed-920a-5c272bb05a76 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:04.936259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d37aa9db-9a88-48ed-920a-5c272bb05a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:04.945645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6e3ee3a2-24b9-4b25-b7c4-22e230fb0b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b3b1e9f1324eaa928f2f3ca9720ae9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:04.956875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37aa9db-9a88-48ed-920a-5c272bb05a76 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:04.965316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da918142-16de-4ea8-bbf0-f661eeba064c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:04.965423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6e3ee3a2-24b9-4b25-b7c4-22e230fb0b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b3b1e9f1324eaa928f2f3ca9720ae9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:04.965935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918142-16de-4ea8-bbf0-f661eeba064c service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:04.967386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918142-16de-4ea8-bbf0-f661eeba064c service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:04.967386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918142-16de-4ea8-bbf0-f661eeba064c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:04.969882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6e3ee3a2-24b9-4b25-b7c4-22e230fb0b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b3b1e9f1324eaa928f2f3ca9720ae9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:05.003929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 876/1718] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:04 2022] DELETE /identity/v3/users/86b3b1e9f1324eaa928f2f3ca9720ae9 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:05.003929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9deaa-689a-4f54-b0e0-3a7e2ea4f4f7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:05.004185 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da918142-16de-4ea8-bbf0-f661eeba064c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:05.004273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9deaa-689a-4f54-b0e0-3a7e2ea4f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:05.004273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9deaa-689a-4f54-b0e0-3a7e2ea4f4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:05.010861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da918142-16de-4ea8-bbf0-f661eeba064c service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:05.043477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 843/1719] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:05.046613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da918142-16de-4ea8-bbf0-f661eeba064c service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:05.085345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da918142-16de-4ea8-bbf0-f661eeba064c service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:05.103024 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-20b9deaa-689a-4f54-b0e0-3a7e2ea4f4f7 None None] MFA Rules not processed for user `20eddc1ca4da4c5bb14566507963c629`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:05.107000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-20b9deaa-689a-4f54-b0e0-3a7e2ea4f4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:05.236520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3e8f9-0839-4aba-8e63-69b90126fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:05.238090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e8f9-0839-4aba-8e63-69b90126fa42 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:05.238385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e8f9-0839-4aba-8e63-69b90126fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:05.240078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e8f9-0839-4aba-8e63-69b90126fa42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:05.240851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3e8f9-0839-4aba-8e63-69b90126fa42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:05.242518 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3e8f9-0839-4aba-8e63-69b90126fa42 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:05.278683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 877/1720] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:05.278683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c394621-ff7e-4bcf-bb46-2fb529884304 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:05.278683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c394621-ff7e-4bcf-bb46-2fb529884304 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:05.278683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c394621-ff7e-4bcf-bb46-2fb529884304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:05.281645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 844/1721] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:05.283999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2bdc5-812d-44d6-a13a-2c1c50ad885a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:05.286757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2bdc5-812d-44d6-a13a-2c1c50ad885a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:05.286757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2bdc5-812d-44d6-a13a-2c1c50ad885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:05.323133 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1c394621-ff7e-4bcf-bb46-2fb529884304 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:05.324365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1c394621-ff7e-4bcf-bb46-2fb529884304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:05.338054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 878/1722] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:05.339033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c394621-ff7e-4bcf-bb46-2fb529884304 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:05.341516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1c394621-ff7e-4bcf-bb46-2fb529884304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:05.356075 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c394621-ff7e-4bcf-bb46-2fb529884304 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:05.358013 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4fd2bdc5-812d-44d6-a13a-2c1c50ad885a None None] MFA Rules not processed for user `764047899a7f46569e12e14dda41b30d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:05.361534 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4fd2bdc5-812d-44d6-a13a-2c1c50ad885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:05.362910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a716a67-88f5-4050-8790-b293a460b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:05.363753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a716a67-88f5-4050-8790-b293a460b227 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:05.364309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a716a67-88f5-4050-8790-b293a460b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:05.364785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a716a67-88f5-4050-8790-b293a460b227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:05.365924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a716a67-88f5-4050-8790-b293a460b227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:05.368084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a716a67-88f5-4050-8790-b293a460b227 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:05.384576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 879/1723] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:05.385581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a716a67-88f5-4050-8790-b293a460b227 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:05.387412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1a716a67-88f5-4050-8790-b293a460b227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:05.415572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a716a67-88f5-4050-8790-b293a460b227 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:05.421416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8be1cd-ee6b-4f07-aa95-f42f0fe82fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:05.422328 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8be1cd-ee6b-4f07-aa95-f42f0fe82fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:05.422886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8be1cd-ee6b-4f07-aa95-f42f0fe82fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:05.428907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8be1cd-ee6b-4f07-aa95-f42f0fe82fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:05.428907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8be1cd-ee6b-4f07-aa95-f42f0fe82fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:05.428907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8be1cd-ee6b-4f07-aa95-f42f0fe82fa2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:05.499000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 845/1724] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:05.500193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2bdc5-812d-44d6-a13a-2c1c50ad885a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:05.501847 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4fd2bdc5-812d-44d6-a13a-2c1c50ad885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:05.579863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 880/1725] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:05 2022] POST /identity/v3/projects => generated 403 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:05.589105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8be1cd-ee6b-4f07-aa95-f42f0fe82fa2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:05.636528 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2bdc5-812d-44d6-a13a-2c1c50ad885a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:05.736759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d7995-bb33-48ed-85a1-d232b90046e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:05.738198 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d7995-bb33-48ed-85a1-d232b90046e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:05.738600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d7995-bb33-48ed-85a1-d232b90046e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:05.739034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d7995-bb33-48ed-85a1-d232b90046e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:05.799538 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8be1cd-ee6b-4f07-aa95-f42f0fe82fa2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:05.820222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1dc25-650f-423c-86ee-32ea826cf57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:05.822150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1dc25-650f-423c-86ee-32ea826cf57d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:05.823919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1dc25-650f-423c-86ee-32ea826cf57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:05.825031 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1dc25-650f-423c-86ee-32ea826cf57d admin admin] PATH_INFO: `/v3/projects/cebc2af56f8c4e4d941ee38c285da843/users/6e57e66b53194054a5fcc27641f008da/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:05.836052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d7995-bb33-48ed-85a1-d232b90046e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:05.838523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d7995-bb33-48ed-85a1-d232b90046e6 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:05.862233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 846/1726] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:05.865758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d7995-bb33-48ed-85a1-d232b90046e6 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:05.897805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d7995-bb33-48ed-85a1-d232b90046e6 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:05.897963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1dc25-650f-423c-86ee-32ea826cf57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebc2af56f8c4e4d941ee38c285da843, user_id=6e57e66b53194054a5fcc27641f008da, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:05.897963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1dc25-650f-423c-86ee-32ea826cf57d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:05.908657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3ae7b-5e09-4329-9cba-04e0c98f7bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:05.909746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3ae7b-5e09-4329-9cba-04e0c98f7bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:05.910195 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3ae7b-5e09-4329-9cba-04e0c98f7bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:05.910627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3ae7b-5e09-4329-9cba-04e0c98f7bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:05.911525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3ae7b-5e09-4329-9cba-04e0c98f7bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:05.916456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3ae7b-5e09-4329-9cba-04e0c98f7bc0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:06.111364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 881/1727] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:05 2022] PUT /identity/v3/projects/cebc2af56f8c4e4d941ee38c285da843/users/6e57e66b53194054a5fcc27641f008da/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:06.111364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf996a-d0f8-4124-8613-aacd68578a28 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:06.111364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf996a-d0f8-4124-8613-aacd68578a28 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:06.111364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf996a-d0f8-4124-8613-aacd68578a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:06.147279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4cbf996a-d0f8-4124-8613-aacd68578a28 None None] MFA Rules not processed for user `6e57e66b53194054a5fcc27641f008da`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:06.149188 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4cbf996a-d0f8-4124-8613-aacd68578a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:06.173285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 847/1728] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:05 2022] POST /identity/v3/users => generated 308 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:06.195937 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3ae7b-5e09-4329-9cba-04e0c98f7bc0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:06.265923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3ae7b-5e09-4329-9cba-04e0c98f7bc0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:06.299334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 882/1729] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:06.307191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf996a-d0f8-4124-8613-aacd68578a28 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:06.507337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf996a-d0f8-4124-8613-aacd68578a28 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:06.531965 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57dd3-4682-468d-b0d2-8538c82264ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:06.533657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57dd3-4682-468d-b0d2-8538c82264ef admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:06.534324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57dd3-4682-468d-b0d2-8538c82264ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:06.535021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57dd3-4682-468d-b0d2-8538c82264ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:06.536131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c57dd3-4682-468d-b0d2-8538c82264ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:06.545321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61a76-4d14-43ed-b917-71bfc96a0456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:06.546273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61a76-4d14-43ed-b917-71bfc96a0456 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:06.546697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61a76-4d14-43ed-b917-71bfc96a0456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:06.547535 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61a76-4d14-43ed-b917-71bfc96a0456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:06.557437 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c57dd3-4682-468d-b0d2-8538c82264ef admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:06.564314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b61a76-4d14-43ed-b917-71bfc96a0456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:06.568559 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b61a76-4d14-43ed-b917-71bfc96a0456 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:06.612404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 848/1730] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:06.613438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61a76-4d14-43ed-b917-71bfc96a0456 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:06.649422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61a76-4d14-43ed-b917-71bfc96a0456 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:06.681682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc2582-09e8-4492-8d3c-849fc1440e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:06.682597 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc2582-09e8-4492-8d3c-849fc1440e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:06.682883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc2582-09e8-4492-8d3c-849fc1440e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:06.683192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc2582-09e8-4492-8d3c-849fc1440e95 admin admin] PATH_INFO: `/v3/projects/690c1de21d204bff9da7e65d38f3610e/users/f60dc040ddc44231a1de123f1fba772d/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:06.757796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc2582-09e8-4492-8d3c-849fc1440e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=690c1de21d204bff9da7e65d38f3610e, user_id=f60dc040ddc44231a1de123f1fba772d, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:06.791373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc2582-09e8-4492-8d3c-849fc1440e95 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:07.147769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 883/1731] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:06 2022] POST /identity/v3/projects => generated 387 bytes in 845 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:07.150364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57dd3-4682-468d-b0d2-8538c82264ef admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:07.160341 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d1c57dd3-4682-468d-b0d2-8538c82264ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:07.217800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 849/1732] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:06 2022] PUT /identity/v3/projects/690c1de21d204bff9da7e65d38f3610e/users/f60dc040ddc44231a1de123f1fba772d/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:07.221531 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc2582-09e8-4492-8d3c-849fc1440e95 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:07.348221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57dd3-4682-468d-b0d2-8538c82264ef admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:07.442409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc2582-09e8-4492-8d3c-849fc1440e95 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:07.465333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7508e-a995-49ce-a790-3cca5e741102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:07.467258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7508e-a995-49ce-a790-3cca5e741102 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:07.480895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7508e-a995-49ce-a790-3cca5e741102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:07.481769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7508e-a995-49ce-a790-3cca5e741102 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:07.485691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7508e-a995-49ce-a790-3cca5e741102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:07.487074 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7508e-a995-49ce-a790-3cca5e741102 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:07.565800 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:07.581772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:07.581772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:07.581772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] PATH_INFO: `/v3/projects/589a58988caf47bbb487e286622d2fb0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:07.581772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=589a58988caf47bbb487e286622d2fb0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:07.591868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:07.781156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 850/1733] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:07 2022] POST /identity/v3/users => generated 300 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:07.781156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7508e-a995-49ce-a790-3cca5e741102 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:07.811466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7508e-a995-49ce-a790-3cca5e741102 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:07.850724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589a58988caf47bbb487e286622d2fb0', 'request_id': 'req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:07.920230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f42ed4-c525-463e-ae41-5dd465cfd2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:07.920977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f42ed4-c525-463e-ae41-5dd465cfd2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:07.921341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f42ed4-c525-463e-ae41-5dd465cfd2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:07.921931 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f42ed4-c525-463e-ae41-5dd465cfd2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:07.922763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f42ed4-c525-463e-ae41-5dd465cfd2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:07.924507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f42ed4-c525-463e-ae41-5dd465cfd2c9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:07.944780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 851/1734] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:07.945749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f42ed4-c525-463e-ae41-5dd465cfd2c9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:07.962927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f42ed4-c525-463e-ae41-5dd465cfd2c9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:07.973131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1a92c-58f9-4dc9-90b6-a82652122a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:07.973981 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1a92c-58f9-4dc9-90b6-a82652122a6d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:07.974376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1a92c-58f9-4dc9-90b6-a82652122a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:07.974767 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1a92c-58f9-4dc9-90b6-a82652122a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:07.975633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1a92c-58f9-4dc9-90b6-a82652122a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:07.977371 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1a92c-58f9-4dc9-90b6-a82652122a6d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:07.989790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 852/1735] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:07.991279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf45f-d58e-4752-a93c-210ddbd2273b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:07.991656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf45f-d58e-4752-a93c-210ddbd2273b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:07.992007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf45f-d58e-4752-a93c-210ddbd2273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:08.035861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-80bbf45f-d58e-4752-a93c-210ddbd2273b None None] MFA Rules not processed for user `ceb69d85e1f24983aa9de1557e468494`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:08.037335 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-80bbf45f-d58e-4752-a93c-210ddbd2273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:08.128353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589a58988caf47bbb487e286622d2fb0', 'request_id': 'req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:08.139342 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589a58988caf47bbb487e286622d2fb0', 'request_id': 'req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:08.159664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] The token cache is being invalidate because project 589a58988caf47bbb487e286622d2fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:08.161085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:08.169846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 853/1736] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:08.171030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbf45f-d58e-4752-a93c-210ddbd2273b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:08.174015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:08.181802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 884/1737] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:07 2022] DELETE /identity/v3/projects/589a58988caf47bbb487e286622d2fb0 => generated 0 bytes in 1032 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:08.185715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:08.189827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:08.197368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbf45f-d58e-4752-a93c-210ddbd2273b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:08.204784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4910c-b12b-4fe8-b14c-e74cecd879a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:08.206045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4910c-b12b-4fe8-b14c-e74cecd879a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:08.206341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4910c-b12b-4fe8-b14c-e74cecd879a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:08.206666 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4910c-b12b-4fe8-b14c-e74cecd879a7 admin admin] PATH_INFO: `/v3/projects/690c1de21d204bff9da7e65d38f3610e/users/f60dc040ddc44231a1de123f1fba772d/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:08.209846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4910c-b12b-4fe8-b14c-e74cecd879a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=690c1de21d204bff9da7e65d38f3610e, user_id=f60dc040ddc44231a1de123f1fba772d, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:08.217677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4910c-b12b-4fe8-b14c-e74cecd879a7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:08.244326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 854/1738] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:08 2022] PUT /identity/v3/projects/690c1de21d204bff9da7e65d38f3610e/users/f60dc040ddc44231a1de123f1fba772d/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:08.248442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4910c-b12b-4fe8-b14c-e74cecd879a7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:08.261577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-87a4910c-b12b-4fe8-b14c-e74cecd879a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:08.273730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c7ea9-cce1-413b-8d5c-2fdc4052a8cb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:08.416696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b808af-b1f6-4cee-84b5-fc09f4ba2c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:08.422810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b808af-b1f6-4cee-84b5-fc09f4ba2c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:08.422810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b808af-b1f6-4cee-84b5-fc09f4ba2c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:08.422810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b808af-b1f6-4cee-84b5-fc09f4ba2c4b admin admin] PATH_INFO: `/v3/projects/e66d2dcb12bf4d0ab36e8c579820a704/users/3cb67155c0d44894a61072761e2e756e/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:08.437774 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b808af-b1f6-4cee-84b5-fc09f4ba2c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66d2dcb12bf4d0ab36e8c579820a704, user_id=3cb67155c0d44894a61072761e2e756e, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:08.441327 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b808af-b1f6-4cee-84b5-fc09f4ba2c4b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:08.495063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4910c-b12b-4fe8-b14c-e74cecd879a7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:08.501131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:08.502065 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:08.502381 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:08.502658 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] PATH_INFO: `/v3/users/9bd77a790548433f8700e16723c4bbff` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:08.504556 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd77a790548433f8700e16723c4bbff)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:08.507601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:08.534817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 885/1739] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:08 2022] PUT /identity/v3/projects/e66d2dcb12bf4d0ab36e8c579820a704/users/3cb67155c0d44894a61072761e2e756e/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:08.534817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b808af-b1f6-4cee-84b5-fc09f4ba2c4b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:08.537201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-24b808af-b1f6-4cee-84b5-fc09f4ba2c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:08.670056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b808af-b1f6-4cee-84b5-fc09f4ba2c4b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:08.677471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:08.679932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:08.680601 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:08.681065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] PATH_INFO: `/v3/projects/57c4d3e6a0444576bfb2c4e6baf86c7b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:08.683212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c4d3e6a0444576bfb2c4e6baf86c7b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:08.685680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:08.870642 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd77a790548433f8700e16723c4bbff'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:08.919382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd77a790548433f8700e16723c4bbff'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:08.919382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd77a790548433f8700e16723c4bbff'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:08.930861 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c4d3e6a0444576bfb2c4e6baf86c7b', 'request_id': 'req-93c9249e-7975-4ff5-bce4-c334761e567f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:08.932448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd77a790548433f8700e16723c4bbff'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:08.933611 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd77a790548433f8700e16723c4bbff'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:09.020499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c4d3e6a0444576bfb2c4e6baf86c7b', 'request_id': 'req-93c9249e-7975-4ff5-bce4-c334761e567f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:09.030011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c4d3e6a0444576bfb2c4e6baf86c7b', 'request_id': 'req-93c9249e-7975-4ff5-bce4-c334761e567f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:09.054102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] The token cache is being invalidate because project 57c4d3e6a0444576bfb2c4e6baf86c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:09.062837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:09.062837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:09.062837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 886/1740] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:08 2022] DELETE /identity/v3/projects/57c4d3e6a0444576bfb2c4e6baf86c7b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:09.062837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:09.062837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:09.154152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 855/1741] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:08 2022] DELETE /identity/v3/users/9bd77a790548433f8700e16723c4bbff => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:09.155467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:09.157652 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:09.203193 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9249e-7975-4ff5-bce4-c334761e567f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:09.360347 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d28bd-44a3-4a8b-b563-ed6652d7be26 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:09.393326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:09.394373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:09.397199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:09.397199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] PATH_INFO: `/v3/users/d1ec92cc7cf04efa9222a72529dae56f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:09.410726 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ec92cc7cf04efa9222a72529dae56f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:09.416040 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:09.435865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab800a-8e43-41f6-a58f-1f6167f37aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:09.436607 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab800a-8e43-41f6-a58f-1f6167f37aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:09.436952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab800a-8e43-41f6-a58f-1f6167f37aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:09.441438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab800a-8e43-41f6-a58f-1f6167f37aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:09.443939 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab800a-8e43-41f6-a58f-1f6167f37aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:09.449237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab800a-8e43-41f6-a58f-1f6167f37aa2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:09.494064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 887/1742] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:09.499920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab800a-8e43-41f6-a58f-1f6167f37aa2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:09.521347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab800a-8e43-41f6-a58f-1f6167f37aa2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:09.533003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519326a9-2672-4786-8474-0281f4de3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:09.533743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519326a9-2672-4786-8474-0281f4de3b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:09.534039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519326a9-2672-4786-8474-0281f4de3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:09.535076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519326a9-2672-4786-8474-0281f4de3b9d admin admin] PATH_INFO: `/v3/projects/e66d2dcb12bf4d0ab36e8c579820a704/users/3cb67155c0d44894a61072761e2e756e/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:09.537666 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519326a9-2672-4786-8474-0281f4de3b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66d2dcb12bf4d0ab36e8c579820a704, user_id=3cb67155c0d44894a61072761e2e756e, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:09.541639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519326a9-2672-4786-8474-0281f4de3b9d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:09.573698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 888/1743] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:09 2022] PUT /identity/v3/projects/e66d2dcb12bf4d0ab36e8c579820a704/users/3cb67155c0d44894a61072761e2e756e/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:09.584806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc03792-6012-4437-8ee9-53f299ebb8cc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:09.585212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc03792-6012-4437-8ee9-53f299ebb8cc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:09.585771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc03792-6012-4437-8ee9-53f299ebb8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:09.626313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9dc03792-6012-4437-8ee9-53f299ebb8cc None None] MFA Rules not processed for user `3cb67155c0d44894a61072761e2e756e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:09.629069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9dc03792-6012-4437-8ee9-53f299ebb8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:09.784430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ec92cc7cf04efa9222a72529dae56f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:09.801135 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 889/1744] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:09.815941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc03792-6012-4437-8ee9-53f299ebb8cc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:09.818170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9dc03792-6012-4437-8ee9-53f299ebb8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:09.833680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ec92cc7cf04efa9222a72529dae56f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:09.843969 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ec92cc7cf04efa9222a72529dae56f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:09.863267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ec92cc7cf04efa9222a72529dae56f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:09.868414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ec92cc7cf04efa9222a72529dae56f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:09.962148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 856/1745] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:09 2022] DELETE /identity/v3/users/d1ec92cc7cf04efa9222a72529dae56f => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:10.019857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc03792-6012-4437-8ee9-53f299ebb8cc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:10.217412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8c99b-7528-4e7e-bf50-f8e8ac5cea08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:10.217412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c99b-7528-4e7e-bf50-f8e8ac5cea08 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:10.217412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c99b-7528-4e7e-bf50-f8e8ac5cea08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:10.217412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c99b-7528-4e7e-bf50-f8e8ac5cea08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:10.218281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aeb8c99b-7528-4e7e-bf50-f8e8ac5cea08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:10.377507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8c99b-7528-4e7e-bf50-f8e8ac5cea08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:10.379412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8c99b-7528-4e7e-bf50-f8e8ac5cea08 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:10.398091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 890/1746] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:10.430452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:10.432493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:10.496899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f4a2a-fe3a-4136-ab39-8c5f045c9d63 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:10.501477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c010d6-450c-43d7-b6fa-0bbd1d414e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:10.502399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c010d6-450c-43d7-b6fa-0bbd1d414e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:10.502678 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c010d6-450c-43d7-b6fa-0bbd1d414e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:10.502946 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c010d6-450c-43d7-b6fa-0bbd1d414e8e admin admin] PATH_INFO: `/v3/users/6e57e66b53194054a5fcc27641f008da` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:10.504112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c010d6-450c-43d7-b6fa-0bbd1d414e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e57e66b53194054a5fcc27641f008da)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:10.506045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c010d6-450c-43d7-b6fa-0bbd1d414e8e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:10.593929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8c99b-7528-4e7e-bf50-f8e8ac5cea08 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:10.595711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aeb8c99b-7528-4e7e-bf50-f8e8ac5cea08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:10.614935 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8c99b-7528-4e7e-bf50-f8e8ac5cea08 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:10.623398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:10.624381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:10.624901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:10.625060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] PATH_INFO: `/v3/projects/19d1dbb8dc594e5a852fa9a112c950a4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:10.626252 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d1dbb8dc594e5a852fa9a112c950a4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:10.628218 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:10.740747 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e3c010d6-450c-43d7-b6fa-0bbd1d414e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e57e66b53194054a5fcc27641f008da'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:10.758671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e3c010d6-450c-43d7-b6fa-0bbd1d414e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e57e66b53194054a5fcc27641f008da'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:10.759817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e3c010d6-450c-43d7-b6fa-0bbd1d414e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e57e66b53194054a5fcc27641f008da'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:10.769411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e3c010d6-450c-43d7-b6fa-0bbd1d414e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e57e66b53194054a5fcc27641f008da'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:10.770572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e3c010d6-450c-43d7-b6fa-0bbd1d414e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e57e66b53194054a5fcc27641f008da'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:10.776086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d1dbb8dc594e5a852fa9a112c950a4', 'request_id': 'req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:10.865526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 857/1747] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:10 2022] DELETE /identity/v3/users/6e57e66b53194054a5fcc27641f008da => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:10.869801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387013-94e7-474e-b784-3fc6c5c1500e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:10.870138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387013-94e7-474e-b784-3fc6c5c1500e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:10.870425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387013-94e7-474e-b784-3fc6c5c1500e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:10.899576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fa387013-94e7-474e-b784-3fc6c5c1500e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:10.901415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fa387013-94e7-474e-b784-3fc6c5c1500e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:10.962957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 858/1748] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:10.963596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa387013-94e7-474e-b784-3fc6c5c1500e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:10.964869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fa387013-94e7-474e-b784-3fc6c5c1500e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:10.982191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa387013-94e7-474e-b784-3fc6c5c1500e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:10.989168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:10.989899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:10.990243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:10.990633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] PATH_INFO: `/v3/projects/6448248615ce4e7eb3a4bdde276bcb84` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:10.992022 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6448248615ce4e7eb3a4bdde276bcb84)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:10.994172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:11.001163 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d1dbb8dc594e5a852fa9a112c950a4', 'request_id': 'req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.007784 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d1dbb8dc594e5a852fa9a112c950a4', 'request_id': 'req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.021949 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] The token cache is being invalidate because project 19d1dbb8dc594e5a852fa9a112c950a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:11.022602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.027622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.030532 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 891/1749] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:10 2022] DELETE /identity/v3/projects/19d1dbb8dc594e5a852fa9a112c950a4 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:11.034305 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:11.039950 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:11.129452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d88d26-96c6-4e7b-9b2e-8396f98a1c30 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:11.189188 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6448248615ce4e7eb3a4bdde276bcb84', 'request_id': 'req-a6e513cb-9b70-4444-bcd2-18d36549c8c9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.197780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01472bf-2c34-4d33-b0ba-434902ed0c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:11.198757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01472bf-2c34-4d33-b0ba-434902ed0c63 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:11.199249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01472bf-2c34-4d33-b0ba-434902ed0c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:11.199924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01472bf-2c34-4d33-b0ba-434902ed0c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:11.202329 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e01472bf-2c34-4d33-b0ba-434902ed0c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:11.215913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01472bf-2c34-4d33-b0ba-434902ed0c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:11.218054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01472bf-2c34-4d33-b0ba-434902ed0c63 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:11.233358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 892/1750] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:11.234523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01472bf-2c34-4d33-b0ba-434902ed0c63 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:11.242064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e01472bf-2c34-4d33-b0ba-434902ed0c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:11.253850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01472bf-2c34-4d33-b0ba-434902ed0c63 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:11.327790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6448248615ce4e7eb3a4bdde276bcb84', 'request_id': 'req-a6e513cb-9b70-4444-bcd2-18d36549c8c9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.333657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:11.339626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:11.339626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:11.339626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] PATH_INFO: `/v3/users/cf4869663dd3407d9acbaca9d26ff46e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:11.339626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4869663dd3407d9acbaca9d26ff46e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:11.340106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6448248615ce4e7eb3a4bdde276bcb84', 'request_id': 'req-a6e513cb-9b70-4444-bcd2-18d36549c8c9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.340230 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:11.358749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] The token cache is being invalidate because project 6448248615ce4e7eb3a4bdde276bcb84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:11.359042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.359999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a6e513cb-9b70-4444-bcd2-18d36549c8c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.362519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 859/1751] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:10 2022] DELETE /identity/v3/projects/6448248615ce4e7eb3a4bdde276bcb84 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:11.363858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ceee4-9713-4b9b-af0d-937186030926 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:11.364544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ceee4-9713-4b9b-af0d-937186030926 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:11.365308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ceee4-9713-4b9b-af0d-937186030926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:11.397773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6d4ceee4-9713-4b9b-af0d-937186030926 None None] MFA Rules not processed for user `f60dc040ddc44231a1de123f1fba772d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:11.399058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6d4ceee4-9713-4b9b-af0d-937186030926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:11.467996 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 860/1752] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:11.469382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f318dbd-d5cf-4b7a-a135-3be180431f64 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:11.469694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f318dbd-d5cf-4b7a-a135-3be180431f64 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:11.469972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f318dbd-d5cf-4b7a-a135-3be180431f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:11.504772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1f318dbd-d5cf-4b7a-a135-3be180431f64 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:11.506147 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1f318dbd-d5cf-4b7a-a135-3be180431f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:11.517199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 861/1753] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:11.532746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a7ac5-cf02-4d08-b151-713648569c25 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:11.533168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a7ac5-cf02-4d08-b151-713648569c25 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:11.533455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a7ac5-cf02-4d08-b151-713648569c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:11.553947 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6b4a7ac5-cf02-4d08-b151-713648569c25 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:11.555172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6b4a7ac5-cf02-4d08-b151-713648569c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:11.564206 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 862/1754] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:11.569250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a7ac5-cf02-4d08-b151-713648569c25 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:11.578651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a7ac5-cf02-4d08-b151-713648569c25 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:11.583187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa422c1-3809-477f-9cff-88abc0308eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:11.583834 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa422c1-3809-477f-9cff-88abc0308eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:11.584113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa422c1-3809-477f-9cff-88abc0308eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:11.584463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa422c1-3809-477f-9cff-88abc0308eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:11.585198 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa422c1-3809-477f-9cff-88abc0308eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:11.585501 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa422c1-3809-477f-9cff-88abc0308eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:11.587127 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa422c1-3809-477f-9cff-88abc0308eb6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:11.607265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 863/1755] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:26:11.610163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa422c1-3809-477f-9cff-88abc0308eb6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:11.619935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa422c1-3809-477f-9cff-88abc0308eb6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:11.625878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a3462-1dbb-411e-b056-fd1b8bf803b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:11.626548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a3462-1dbb-411e-b056-fd1b8bf803b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:11.626834 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a3462-1dbb-411e-b056-fd1b8bf803b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:11.627112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a3462-1dbb-411e-b056-fd1b8bf803b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:11.627800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a3462-1dbb-411e-b056-fd1b8bf803b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:11.629741 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a3462-1dbb-411e-b056-fd1b8bf803b7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:11.679854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4869663dd3407d9acbaca9d26ff46e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.697057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4869663dd3407d9acbaca9d26ff46e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.751334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 864/1756] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:11 2022] POST /identity/v3/projects => generated 357 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:11.755699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a3462-1dbb-411e-b056-fd1b8bf803b7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:11.830141 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a3462-1dbb-411e-b056-fd1b8bf803b7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:11.834945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c356f-c635-4973-b035-6b91ee4d0922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:11.835628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c356f-c635-4973-b035-6b91ee4d0922 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:11.835909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c356f-c635-4973-b035-6b91ee4d0922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:11.836180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c356f-c635-4973-b035-6b91ee4d0922 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:11.836870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c356f-c635-4973-b035-6b91ee4d0922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:11.838809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c356f-c635-4973-b035-6b91ee4d0922 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:11.883043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4869663dd3407d9acbaca9d26ff46e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.895095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4869663dd3407d9acbaca9d26ff46e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.895095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4869663dd3407d9acbaca9d26ff46e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:11.900762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 893/1757] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:11 2022] DELETE /identity/v3/users/cf4869663dd3407d9acbaca9d26ff46e => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:11.901775 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:11.905167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:11.946620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 865/1758] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:11 2022] POST /identity/v3/users => generated 279 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:11.951138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c356f-c635-4973-b035-6b91ee4d0922 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:11.956463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7b7c356f-c635-4973-b035-6b91ee4d0922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:11.983278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051988c-f63b-4bc5-b39c-83f8c27b0c48 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:11.986959 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c356f-c635-4973-b035-6b91ee4d0922 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:11.988675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:11.989758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:11.990107 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:11.990448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] PATH_INFO: `/v3/projects/cebc2af56f8c4e4d941ee38c285da843` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:11.992148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cebc2af56f8c4e4d941ee38c285da843)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:11.994227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:12.003851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93a8a4-0eff-4af6-a42b-b52b5622712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:12.004883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93a8a4-0eff-4af6-a42b-b52b5622712e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:12.005394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93a8a4-0eff-4af6-a42b-b52b5622712e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:12.006204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93a8a4-0eff-4af6-a42b-b52b5622712e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:12.007285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93a8a4-0eff-4af6-a42b-b52b5622712e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:12.009421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93a8a4-0eff-4af6-a42b-b52b5622712e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:12.020593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 866/1759] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:12.026079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93a8a4-0eff-4af6-a42b-b52b5622712e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:12.039522 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93a8a4-0eff-4af6-a42b-b52b5622712e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:12.047259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71d419-d1d7-42a9-9847-dbe197bd8fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:12.048279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71d419-d1d7-42a9-9847-dbe197bd8fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:12.049304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71d419-d1d7-42a9-9847-dbe197bd8fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:12.049759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71d419-d1d7-42a9-9847-dbe197bd8fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:12.050685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71d419-d1d7-42a9-9847-dbe197bd8fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:12.054467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71d419-d1d7-42a9-9847-dbe197bd8fdc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:12.071357 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 867/1760] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:26:12.077192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71d419-d1d7-42a9-9847-dbe197bd8fdc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:12.089376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71d419-d1d7-42a9-9847-dbe197bd8fdc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:12.114852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cebc2af56f8c4e4d941ee38c285da843', 'request_id': 'req-2fd55d2e-468a-4658-b6ce-14085df61ea6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:12.158422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad60b9-79e3-4af9-adbe-d4e206306270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:12.159326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad60b9-79e3-4af9-adbe-d4e206306270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:12.159607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad60b9-79e3-4af9-adbe-d4e206306270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:12.159880 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad60b9-79e3-4af9-adbe-d4e206306270 admin admin] PATH_INFO: `/v3/projects/4f446c7dbda247c4b6ed31560ebecd9a/users/1fe5c71eb09b4c7ab2639f4183bbed20/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:12.197397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad60b9-79e3-4af9-adbe-d4e206306270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f446c7dbda247c4b6ed31560ebecd9a, user_id=1fe5c71eb09b4c7ab2639f4183bbed20, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:12.202453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad60b9-79e3-4af9-adbe-d4e206306270 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:12.225019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cebc2af56f8c4e4d941ee38c285da843', 'request_id': 'req-2fd55d2e-468a-4658-b6ce-14085df61ea6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:12.238739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cebc2af56f8c4e4d941ee38c285da843', 'request_id': 'req-2fd55d2e-468a-4658-b6ce-14085df61ea6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:12.269210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] The token cache is being invalidate because project cebc2af56f8c4e4d941ee38c285da843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:12.269776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:12.271546 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:12.274554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 894/1761] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:11 2022] DELETE /identity/v3/projects/cebc2af56f8c4e4d941ee38c285da843 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:12.285299 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:12.287645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:12.342917 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 868/1762] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:12 2022] PUT /identity/v3/projects/4f446c7dbda247c4b6ed31560ebecd9a/users/1fe5c71eb09b4c7ab2639f4183bbed20/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:12.355395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55d2e-468a-4658-b6ce-14085df61ea6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:12.361163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d010ef-d354-4eda-9088-287a33548a01 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:12.361518 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d010ef-d354-4eda-9088-287a33548a01 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:12.361993 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d010ef-d354-4eda-9088-287a33548a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:12.421655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-87d010ef-d354-4eda-9088-287a33548a01 None None] MFA Rules not processed for user `1fe5c71eb09b4c7ab2639f4183bbed20`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:12.422951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-87d010ef-d354-4eda-9088-287a33548a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:12.469078 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:12.470082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:12.470422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:12.471652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] PATH_INFO: `/v3/users/3cb67155c0d44894a61072761e2e756e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:12.473041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb67155c0d44894a61072761e2e756e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:12.475162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:12.628682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 869/1763] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:12.633173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d010ef-d354-4eda-9088-287a33548a01 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:12.635463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-87d010ef-d354-4eda-9088-287a33548a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:12.699144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d010ef-d354-4eda-9088-287a33548a01 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:12.732799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233437a-efe4-4666-a6ba-97f2fb5ff089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:12.734040 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233437a-efe4-4666-a6ba-97f2fb5ff089 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:12.734506 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233437a-efe4-4666-a6ba-97f2fb5ff089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:12.735038 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233437a-efe4-4666-a6ba-97f2fb5ff089 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:12.736938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233437a-efe4-4666-a6ba-97f2fb5ff089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:12.741777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233437a-efe4-4666-a6ba-97f2fb5ff089 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:12.819518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb67155c0d44894a61072761e2e756e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:12.846108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb67155c0d44894a61072761e2e756e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:12.928394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 870/1764] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:12 2022] POST /identity/v3/projects => generated 355 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:12.929789 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233437a-efe4-4666-a6ba-97f2fb5ff089 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:12.999972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb67155c0d44894a61072761e2e756e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:13.017009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb67155c0d44894a61072761e2e756e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:13.017009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb67155c0d44894a61072761e2e756e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:13.020578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233437a-efe4-4666-a6ba-97f2fb5ff089 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:13.026684 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c007729-d316-484f-8449-7c20cc71d2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:13.027437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c007729-d316-484f-8449-7c20cc71d2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:13.027779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c007729-d316-484f-8449-7c20cc71d2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:13.028887 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c007729-d316-484f-8449-7c20cc71d2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:13.029752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 895/1765] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:12 2022] DELETE /identity/v3/users/3cb67155c0d44894a61072761e2e756e => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:13.033113 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:13.035128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:13.038993 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c007729-d316-484f-8449-7c20cc71d2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:13.042655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c007729-d316-484f-8449-7c20cc71d2d4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:13.145794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17ef55-427c-4834-b2b4-32c9a0be85e8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:13.151089 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:13.151980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:13.152265 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:13.152614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] PATH_INFO: `/v3/projects/88e634eecb394597a56e7f87f369e7de` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:13.154686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e634eecb394597a56e7f87f369e7de)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:13.156647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:13.197149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 871/1766] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:12 2022] POST /identity/v3/users => generated 284 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:13.201676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c007729-d316-484f-8449-7c20cc71d2d4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:13.204482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3c007729-d316-484f-8449-7c20cc71d2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:13.218768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c007729-d316-484f-8449-7c20cc71d2d4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:13.227239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a53a2-c7fc-4cad-913c-037407370d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:13.227367 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a53a2-c7fc-4cad-913c-037407370d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:13.227943 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a53a2-c7fc-4cad-913c-037407370d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:13.233736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a53a2-c7fc-4cad-913c-037407370d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:13.234888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a53a2-c7fc-4cad-913c-037407370d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:13.237831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a53a2-c7fc-4cad-913c-037407370d3f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:13.257800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 872/1767] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:26:13.263364 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a53a2-c7fc-4cad-913c-037407370d3f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:13.274620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a53a2-c7fc-4cad-913c-037407370d3f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:13.280238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88355281-a272-43c7-a821-2b2601cef73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:13.280519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355281-a272-43c7-a821-2b2601cef73a admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:13.280805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355281-a272-43c7-a821-2b2601cef73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:13.281274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355281-a272-43c7-a821-2b2601cef73a admin admin] PATH_INFO: `/v3/projects/8adcdcd8c2864c5cb9f60e6b97b0ccbe/users/85190321fd994cfebab5b1c028bd50e9/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:13.304006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88355281-a272-43c7-a821-2b2601cef73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8adcdcd8c2864c5cb9f60e6b97b0ccbe, user_id=85190321fd994cfebab5b1c028bd50e9, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:13.306793 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88355281-a272-43c7-a821-2b2601cef73a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:13.452799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 873/1768] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:13 2022] PUT /identity/v3/projects/8adcdcd8c2864c5cb9f60e6b97b0ccbe/users/85190321fd994cfebab5b1c028bd50e9/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:13.469678 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88355281-a272-43c7-a821-2b2601cef73a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:13.510213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e634eecb394597a56e7f87f369e7de', 'request_id': 'req-1e6df369-369d-44b6-b0be-66757b1fd554'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:13.627241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88355281-a272-43c7-a821-2b2601cef73a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:13.633072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e347404-6ea4-46e3-b2f7-cacfc9e18515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:13.633752 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e347404-6ea4-46e3-b2f7-cacfc9e18515 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:13.634047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e347404-6ea4-46e3-b2f7-cacfc9e18515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:13.634476 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e347404-6ea4-46e3-b2f7-cacfc9e18515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:13.635222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e347404-6ea4-46e3-b2f7-cacfc9e18515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:13.636928 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e347404-6ea4-46e3-b2f7-cacfc9e18515 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:13.657664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e634eecb394597a56e7f87f369e7de', 'request_id': 'req-1e6df369-369d-44b6-b0be-66757b1fd554'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:13.688599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e634eecb394597a56e7f87f369e7de', 'request_id': 'req-1e6df369-369d-44b6-b0be-66757b1fd554'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:13.699434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 874/1769] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:13.701417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e347404-6ea4-46e3-b2f7-cacfc9e18515 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:13.711537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] The token cache is being invalidate because project 88e634eecb394597a56e7f87f369e7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:13.712829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:13.713902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1e6df369-369d-44b6-b0be-66757b1fd554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:13.717486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 896/1770] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:13 2022] DELETE /identity/v3/projects/88e634eecb394597a56e7f87f369e7de => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:13.720046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e347404-6ea4-46e3-b2f7-cacfc9e18515 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:13.724772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937aeb2-6546-4330-b2c9-27709e935dc9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:13.725142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937aeb2-6546-4330-b2c9-27709e935dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:13.725431 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937aeb2-6546-4330-b2c9-27709e935dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:13.740774 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac175bb-2474-434d-8056-8e232b866c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:13.742345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac175bb-2474-434d-8056-8e232b866c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:13.742837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac175bb-2474-434d-8056-8e232b866c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:13.743311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac175bb-2474-434d-8056-8e232b866c4d admin admin] PATH_INFO: `/v3/projects/8adcdcd8c2864c5cb9f60e6b97b0ccbe/users/85190321fd994cfebab5b1c028bd50e9/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:13.749481 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac175bb-2474-434d-8056-8e232b866c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8adcdcd8c2864c5cb9f60e6b97b0ccbe, user_id=85190321fd994cfebab5b1c028bd50e9, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:13.752155 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac175bb-2474-434d-8056-8e232b866c4d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:13.770032 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9937aeb2-6546-4330-b2c9-27709e935dc9 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:13.771916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9937aeb2-6546-4330-b2c9-27709e935dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:13.779329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 875/1771] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:13 2022] PUT /identity/v3/projects/8adcdcd8c2864c5cb9f60e6b97b0ccbe/users/85190321fd994cfebab5b1c028bd50e9/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:13.780992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bd83d-1d1b-43d4-9c5b-4dedac84a265 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:13.781256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bd83d-1d1b-43d4-9c5b-4dedac84a265 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:13.782270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bd83d-1d1b-43d4-9c5b-4dedac84a265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:13.833457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a07bd83d-1d1b-43d4-9c5b-4dedac84a265 None None] MFA Rules not processed for user `85190321fd994cfebab5b1c028bd50e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:13.834690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a07bd83d-1d1b-43d4-9c5b-4dedac84a265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:13.873659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 897/1772] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:13.882081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1132a7-a3b5-4f1b-9c07-7685c81e74f6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:13.882365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1132a7-a3b5-4f1b-9c07-7685c81e74f6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:13.883545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1132a7-a3b5-4f1b-9c07-7685c81e74f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:13.912377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fb1132a7-a3b5-4f1b-9c07-7685c81e74f6 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:13.913655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fb1132a7-a3b5-4f1b-9c07-7685c81e74f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:13.923396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 898/1773] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:13.932250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1132a7-a3b5-4f1b-9c07-7685c81e74f6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:13.945643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1132a7-a3b5-4f1b-9c07-7685c81e74f6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:13.964752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d5a2-6983-4774-a74b-a49ad66f05ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:13.966935 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d5a2-6983-4774-a74b-a49ad66f05ca admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:13.967267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d5a2-6983-4774-a74b-a49ad66f05ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:13.967546 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d5a2-6983-4774-a74b-a49ad66f05ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:13.968400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33d5a2-6983-4774-a74b-a49ad66f05ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:13.968717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33d5a2-6983-4774-a74b-a49ad66f05ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:13.971071 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33d5a2-6983-4774-a74b-a49ad66f05ca admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:13.990605 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 899/1774] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:13.995500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d5a2-6983-4774-a74b-a49ad66f05ca admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:14.000570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 876/1775] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:14.008851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d5a2-6983-4774-a74b-a49ad66f05ca admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:14.017455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bd83d-1d1b-43d4-9c5b-4dedac84a265 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:14.019306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a07bd83d-1d1b-43d4-9c5b-4dedac84a265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:14.020018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44c9a1-6aff-4793-afc4-cef416d70b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:14.020875 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44c9a1-6aff-4793-afc4-cef416d70b4e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:14.021198 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44c9a1-6aff-4793-afc4-cef416d70b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:14.021475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44c9a1-6aff-4793-afc4-cef416d70b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:14.022213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44c9a1-6aff-4793-afc4-cef416d70b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:14.025074 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44c9a1-6aff-4793-afc4-cef416d70b4e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:14.127466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bd83d-1d1b-43d4-9c5b-4dedac84a265 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:14.132406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2118c2d-023b-475c-82df-03463bbc0d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:14.134251 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118c2d-023b-475c-82df-03463bbc0d47 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:14.134875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118c2d-023b-475c-82df-03463bbc0d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:14.135164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118c2d-023b-475c-82df-03463bbc0d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:14.148379 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2118c2d-023b-475c-82df-03463bbc0d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:14.149800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2118c2d-023b-475c-82df-03463bbc0d47 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:14.161220 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 877/1776] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:14.208481 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 900/1777] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:13 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:14.209753 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2118c2d-023b-475c-82df-03463bbc0d47 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:14.222561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2118c2d-023b-475c-82df-03463bbc0d47 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:14.365282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f39404-7287-4e39-96ae-7d1c03cfb6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:14.366469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f39404-7287-4e39-96ae-7d1c03cfb6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:14.366982 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f39404-7287-4e39-96ae-7d1c03cfb6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:14.367486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f39404-7287-4e39-96ae-7d1c03cfb6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:14.368352 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f39404-7287-4e39-96ae-7d1c03cfb6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:14.370505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f39404-7287-4e39-96ae-7d1c03cfb6f9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:14.455840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44c9a1-6aff-4793-afc4-cef416d70b4e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:14.457886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5a44c9a1-6aff-4793-afc4-cef416d70b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:14.495543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44c9a1-6aff-4793-afc4-cef416d70b4e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:14.507160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 878/1778] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:14 2022] POST /identity/v3/users => generated 289 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:14.515969 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:14.516862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:14.517175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:14.517448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] PATH_INFO: `/v3/projects/e66d2dcb12bf4d0ab36e8c579820a704` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:14.518735 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66d2dcb12bf4d0ab36e8c579820a704)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:14.521772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:14.521907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f39404-7287-4e39-96ae-7d1c03cfb6f9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:14.536017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f39404-7287-4e39-96ae-7d1c03cfb6f9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:14.541456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dffed-e56e-4767-9793-2bda6c60eee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:14.542389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dffed-e56e-4767-9793-2bda6c60eee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:14.542678 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dffed-e56e-4767-9793-2bda6c60eee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:14.542962 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dffed-e56e-4767-9793-2bda6c60eee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:14.544262 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51dffed-e56e-4767-9793-2bda6c60eee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:14.545940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51dffed-e56e-4767-9793-2bda6c60eee2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:14.562926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 879/1779] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:14.562926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dffed-e56e-4767-9793-2bda6c60eee2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:14.631102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dffed-e56e-4767-9793-2bda6c60eee2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:14.636178 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76f31e-89e9-491a-b89e-e59deba96999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:14.636983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76f31e-89e9-491a-b89e-e59deba96999 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:14.637728 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76f31e-89e9-491a-b89e-e59deba96999 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:14.639477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76f31e-89e9-491a-b89e-e59deba96999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:14.641721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8a76f31e-89e9-491a-b89e-e59deba96999 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:14.722999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66d2dcb12bf4d0ab36e8c579820a704', 'request_id': 'req-83990985-aa07-4554-bf12-3b13f65422fd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:14.740280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76f31e-89e9-491a-b89e-e59deba96999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:14.742374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76f31e-89e9-491a-b89e-e59deba96999 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:14.763792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 880/1780] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:14.769166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76f31e-89e9-491a-b89e-e59deba96999 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:14.790056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76f31e-89e9-491a-b89e-e59deba96999 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:14.854185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66d2dcb12bf4d0ab36e8c579820a704', 'request_id': 'req-83990985-aa07-4554-bf12-3b13f65422fd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:14.875130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66d2dcb12bf4d0ab36e8c579820a704', 'request_id': 'req-83990985-aa07-4554-bf12-3b13f65422fd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:14.879637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae89fa-5b4e-4b56-988b-68728de4e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:14.880003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae89fa-5b4e-4b56-988b-68728de4e927 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:14.880227 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae89fa-5b4e-4b56-988b-68728de4e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:14.880502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae89fa-5b4e-4b56-988b-68728de4e927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:14.881578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae89fa-5b4e-4b56-988b-68728de4e927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:14.884563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae89fa-5b4e-4b56-988b-68728de4e927 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:14.907092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 881/1781] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:14.908627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae89fa-5b4e-4b56-988b-68728de4e927 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:14.910065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] The token cache is being invalidate because project e66d2dcb12bf4d0ab36e8c579820a704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:14.910365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:14.913533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-83990985-aa07-4554-bf12-3b13f65422fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:14.920885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 901/1782] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:14 2022] DELETE /identity/v3/projects/e66d2dcb12bf4d0ab36e8c579820a704 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:14.926145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602428f-b898-4d63-861a-cac4e06f5c80 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:14.928062 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae89fa-5b4e-4b56-988b-68728de4e927 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:14.929646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602428f-b898-4d63-861a-cac4e06f5c80 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:14.929938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602428f-b898-4d63-861a-cac4e06f5c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:14.938691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3e3ad-466a-4ba7-b716-a889092c4832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:14.939610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e3ad-466a-4ba7-b716-a889092c4832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:14.939898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e3ad-466a-4ba7-b716-a889092c4832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:14.940271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e3ad-466a-4ba7-b716-a889092c4832 admin admin] PATH_INFO: `/v3/projects/8678367bd0214c508311a75bf6eab669/users/02788c1df7af402782640515be4442f4/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:14.964014 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3e3ad-466a-4ba7-b716-a889092c4832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8678367bd0214c508311a75bf6eab669, user_id=02788c1df7af402782640515be4442f4, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:14.965449 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3e3ad-466a-4ba7-b716-a889092c4832 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:14.988497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0602428f-b898-4d63-861a-cac4e06f5c80 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:14.989823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0602428f-b898-4d63-861a-cac4e06f5c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:15.003083 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 902/1783] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:15.011824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbee7a2-75bb-4610-9387-81124f3eabd6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:15.012166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbee7a2-75bb-4610-9387-81124f3eabd6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:15.012761 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbee7a2-75bb-4610-9387-81124f3eabd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:15.054714 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2bbee7a2-75bb-4610-9387-81124f3eabd6 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:15.055972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2bbee7a2-75bb-4610-9387-81124f3eabd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:15.066211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 882/1784] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:14 2022] PUT /identity/v3/projects/8678367bd0214c508311a75bf6eab669/users/02788c1df7af402782640515be4442f4/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:15.075560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29713-0a95-46fd-87d0-177dcf53c1e9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:15.075560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29713-0a95-46fd-87d0-177dcf53c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:15.075560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29713-0a95-46fd-87d0-177dcf53c1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:15.155817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8fe29713-0a95-46fd-87d0-177dcf53c1e9 None None] MFA Rules not processed for user `02788c1df7af402782640515be4442f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:15.157780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8fe29713-0a95-46fd-87d0-177dcf53c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:15.197748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 903/1785] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:15.203420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbee7a2-75bb-4610-9387-81124f3eabd6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:15.216318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbee7a2-75bb-4610-9387-81124f3eabd6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:15.222877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ad100-7c91-4808-8119-fec2ced83281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:15.224532 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ad100-7c91-4808-8119-fec2ced83281 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:15.225191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ad100-7c91-4808-8119-fec2ced83281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:15.225716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ad100-7c91-4808-8119-fec2ced83281 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:15.227003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ad100-7c91-4808-8119-fec2ced83281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:15.227556 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ad100-7c91-4808-8119-fec2ced83281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:15.229692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ad100-7c91-4808-8119-fec2ced83281 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:15.245082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 904/1786] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:15.250134 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ad100-7c91-4808-8119-fec2ced83281 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:15.278400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 883/1787] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:15.279688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe29713-0a95-46fd-87d0-177dcf53c1e9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:15.286515 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8fe29713-0a95-46fd-87d0-177dcf53c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:15.297825 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ad100-7c91-4808-8119-fec2ced83281 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:15.311992 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b34d7a-79c3-475b-abd7-cfc361d97c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:15.329158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe29713-0a95-46fd-87d0-177dcf53c1e9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:15.329599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34d7a-79c3-475b-abd7-cfc361d97c19 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:15.329599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34d7a-79c3-475b-abd7-cfc361d97c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:15.329599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34d7a-79c3-475b-abd7-cfc361d97c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:15.329599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b34d7a-79c3-475b-abd7-cfc361d97c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:15.329599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b34d7a-79c3-475b-abd7-cfc361d97c19 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:15.329976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ab81-b45c-482f-b808-cd47e67cc6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:15.329976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ab81-b45c-482f-b808-cd47e67cc6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:15.329976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ab81-b45c-482f-b808-cd47e67cc6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:15.329976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ab81-b45c-482f-b808-cd47e67cc6c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:15.334154 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649ab81-b45c-482f-b808-cd47e67cc6c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:15.336478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649ab81-b45c-482f-b808-cd47e67cc6c7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:15.512946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 905/1788] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:15 2022] POST /identity/v3/projects => generated 375 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:15.514155 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b34d7a-79c3-475b-abd7-cfc361d97c19 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:15.520286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-94b34d7a-79c3-475b-abd7-cfc361d97c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:15.556549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 884/1789] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:15 2022] POST /identity/v3/projects => generated 377 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:15.557601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ab81-b45c-482f-b808-cd47e67cc6c7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:15.650935 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b34d7a-79c3-475b-abd7-cfc361d97c19 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:15.719469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ab81-b45c-482f-b808-cd47e67cc6c7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:15.726745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690db4f-8eda-439a-a7e6-c994e21a93ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:15.727231 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690db4f-8eda-439a-a7e6-c994e21a93ea admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:15.727510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690db4f-8eda-439a-a7e6-c994e21a93ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:15.727781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690db4f-8eda-439a-a7e6-c994e21a93ea admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:15.728539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690db4f-8eda-439a-a7e6-c994e21a93ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:15.731652 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690db4f-8eda-439a-a7e6-c994e21a93ea admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:15.751646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:15.754424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:15.755553 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:15.756074 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] PATH_INFO: `/v3/users/20eddc1ca4da4c5bb14566507963c629` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:15.757853 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] RBAC: Authorizing `identity:delete_user(user_id=20eddc1ca4da4c5bb14566507963c629)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:15.761631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:15.910975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 885/1790] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:15 2022] POST /identity/v3/users => generated 288 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:15.912095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690db4f-8eda-439a-a7e6-c994e21a93ea admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:15.930860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690db4f-8eda-439a-a7e6-c994e21a93ea admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:15.944230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a98b6c-b488-4223-b1c3-69e7cc87bc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:15.945259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a98b6c-b488-4223-b1c3-69e7cc87bc60 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:15.947125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a98b6c-b488-4223-b1c3-69e7cc87bc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:15.947574 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a98b6c-b488-4223-b1c3-69e7cc87bc60 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:15.956210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a98b6c-b488-4223-b1c3-69e7cc87bc60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:15.958580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a98b6c-b488-4223-b1c3-69e7cc87bc60 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:16.032190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20eddc1ca4da4c5bb14566507963c629'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:16.047742 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20eddc1ca4da4c5bb14566507963c629'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:16.083106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 886/1791] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:15 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:16.084352 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a98b6c-b488-4223-b1c3-69e7cc87bc60 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:16.097845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a98b6c-b488-4223-b1c3-69e7cc87bc60 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:16.104191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8675d5a-8b76-4f95-b191-bbc43394bd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:16.105100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675d5a-8b76-4f95-b191-bbc43394bd5b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:16.105555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675d5a-8b76-4f95-b191-bbc43394bd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:16.105794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675d5a-8b76-4f95-b191-bbc43394bd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:16.107270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8675d5a-8b76-4f95-b191-bbc43394bd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:16.108900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8675d5a-8b76-4f95-b191-bbc43394bd5b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:16.122864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 887/1792] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:16.126931 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8675d5a-8b76-4f95-b191-bbc43394bd5b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:16.140142 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8675d5a-8b76-4f95-b191-bbc43394bd5b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:16.144331 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb14ec4-025a-4c38-bafc-3ed8ae1408d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:16.144696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb14ec4-025a-4c38-bafc-3ed8ae1408d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:16.145105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb14ec4-025a-4c38-bafc-3ed8ae1408d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:16.145470 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb14ec4-025a-4c38-bafc-3ed8ae1408d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:16.146361 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb14ec4-025a-4c38-bafc-3ed8ae1408d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:16.148056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb14ec4-025a-4c38-bafc-3ed8ae1408d5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:16.167814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 888/1793] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:16.169035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20eddc1ca4da4c5bb14566507963c629'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:16.172578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb14ec4-025a-4c38-bafc-3ed8ae1408d5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:16.179091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20eddc1ca4da4c5bb14566507963c629'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:16.179954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20eddc1ca4da4c5bb14566507963c629'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:16.181662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb14ec4-025a-4c38-bafc-3ed8ae1408d5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:16.187711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d782e42-475e-4afd-9f60-e6e6b34984d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:16.188413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782e42-475e-4afd-9f60-e6e6b34984d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:16.188717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782e42-475e-4afd-9f60-e6e6b34984d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:16.189186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782e42-475e-4afd-9f60-e6e6b34984d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:16.189401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 906/1794] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:15 2022] DELETE /identity/v3/users/20eddc1ca4da4c5bb14566507963c629 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:16.190106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d782e42-475e-4afd-9f60-e6e6b34984d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:16.190770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:16.192063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d782e42-475e-4afd-9f60-e6e6b34984d3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:16.193170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:16.205016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 889/1795] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:16.208345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d782e42-475e-4afd-9f60-e6e6b34984d3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:16.212944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7d782e42-475e-4afd-9f60-e6e6b34984d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:16.229248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d782e42-475e-4afd-9f60-e6e6b34984d3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:16.295690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea145e0-0911-4868-8079-4ba2d2bfe73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:16.296637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea145e0-0911-4868-8079-4ba2d2bfe73e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:16.296919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea145e0-0911-4868-8079-4ba2d2bfe73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:16.297227 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea145e0-0911-4868-8079-4ba2d2bfe73e admin admin] PATH_INFO: `/v3/projects/b241d161dcbf4605ab30e2a65efbb65f/users/ac6cc188a66e45d3bd6226b8e423d303/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:16.309390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d4910-3291-46cd-8be9-e0a5f7d907db admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:16.315744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea145e0-0911-4868-8079-4ba2d2bfe73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b241d161dcbf4605ab30e2a65efbb65f, user_id=ac6cc188a66e45d3bd6226b8e423d303, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:16.316154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69fa58-37a6-4f4d-a295-261f98c9d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:16.317310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69fa58-37a6-4f4d-a295-261f98c9d20e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:16.317807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69fa58-37a6-4f4d-a295-261f98c9d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:16.318353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69fa58-37a6-4f4d-a295-261f98c9d20e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:16.319305 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69fa58-37a6-4f4d-a295-261f98c9d20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:16.319650 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea145e0-0911-4868-8079-4ba2d2bfe73e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:16.321507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69fa58-37a6-4f4d-a295-261f98c9d20e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:16.335989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 907/1796] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:16.342914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69fa58-37a6-4f4d-a295-261f98c9d20e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:16.354732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69fa58-37a6-4f4d-a295-261f98c9d20e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:16.361889 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629db7a-63f3-40d5-b5b8-cdce8a13652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:16.365865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629db7a-63f3-40d5-b5b8-cdce8a13652e admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:16.366306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629db7a-63f3-40d5-b5b8-cdce8a13652e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:16.367106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629db7a-63f3-40d5-b5b8-cdce8a13652e admin admin] PATH_INFO: `/v3/projects/41547bc5007a407abadf44872469ffdc/users/1517023ded0b473484d0198f9d19b96d/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:16.396981 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 890/1797] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:16 2022] PUT /identity/v3/projects/b241d161dcbf4605ab30e2a65efbb65f/users/ac6cc188a66e45d3bd6226b8e423d303/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:16.399440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bc44c-1dc3-4eeb-83e6-db7eb98d1113 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:16.399747 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bc44c-1dc3-4eeb-83e6-db7eb98d1113 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:16.400060 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bc44c-1dc3-4eeb-83e6-db7eb98d1113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:16.404689 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629db7a-63f3-40d5-b5b8-cdce8a13652e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41547bc5007a407abadf44872469ffdc, user_id=1517023ded0b473484d0198f9d19b96d, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:16.412671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629db7a-63f3-40d5-b5b8-cdce8a13652e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:16.499163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-787bc44c-1dc3-4eeb-83e6-db7eb98d1113 None None] MFA Rules not processed for user `ac6cc188a66e45d3bd6226b8e423d303`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:16.500555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-787bc44c-1dc3-4eeb-83e6-db7eb98d1113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:16.523552 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 908/1798] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:16 2022] PUT /identity/v3/projects/41547bc5007a407abadf44872469ffdc/users/1517023ded0b473484d0198f9d19b96d/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:16.535881 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3d4a7-48c7-4c8c-9475-81af426dd6dd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:16.536414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3d4a7-48c7-4c8c-9475-81af426dd6dd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:16.537076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3d4a7-48c7-4c8c-9475-81af426dd6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:16.583614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d4e3d4a7-48c7-4c8c-9475-81af426dd6dd None None] MFA Rules not processed for user `1517023ded0b473484d0198f9d19b96d`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:16.585546 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d4e3d4a7-48c7-4c8c-9475-81af426dd6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:16.757901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 891/1799] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:16.762956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58774ac-0391-4d02-9b9b-ecfd68ad9f16 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:16.763453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58774ac-0391-4d02-9b9b-ecfd68ad9f16 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:16.763843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58774ac-0391-4d02-9b9b-ecfd68ad9f16 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:16.769819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 892/1800] 10.222.0.61 () {54 vars in 921 bytes} [Tue Apr 12 14:26:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:26:16.775562 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58774ac-0391-4d02-9b9b-ecfd68ad9f16 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:16.823316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 909/1801] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:16.828151 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012876-1413-408a-b0f5-bbc4447bcebd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:16.829596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012876-1413-408a-b0f5-bbc4447bcebd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:16.830056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012876-1413-408a-b0f5-bbc4447bcebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:16.909983 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fa012876-1413-408a-b0f5-bbc4447bcebd None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:16.910732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fa012876-1413-408a-b0f5-bbc4447bcebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:16.978317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58774ac-0391-4d02-9b9b-ecfd68ad9f16 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:16.988186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cc189-53bd-46d3-abf2-ee6a4e774352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:16.989195 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cc189-53bd-46d3-abf2-ee6a4e774352 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:16.989667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cc189-53bd-46d3-abf2-ee6a4e774352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:16.990180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cc189-53bd-46d3-abf2-ee6a4e774352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:16.991059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cc189-53bd-46d3-abf2-ee6a4e774352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:16.993592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cc189-53bd-46d3-abf2-ee6a4e774352 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:17.049471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 910/1802] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Apr 12 14:26:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:17.050432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa012876-1413-408a-b0f5-bbc4447bcebd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:17.069568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa012876-1413-408a-b0f5-bbc4447bcebd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:17.070037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4e0af-098f-477b-960a-0dc8ee36f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:17.071065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4e0af-098f-477b-960a-0dc8ee36f3ce admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:17.071411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4e0af-098f-477b-960a-0dc8ee36f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:17.071753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4e0af-098f-477b-960a-0dc8ee36f3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:17.072531 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4e0af-098f-477b-960a-0dc8ee36f3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:17.075978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4e0af-098f-477b-960a-0dc8ee36f3ce admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:17.146080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 893/1803] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:16 2022] POST /identity/v3/projects => generated 375 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:17.150382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cc189-53bd-46d3-abf2-ee6a4e774352 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:17.235760 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 911/1804] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:17 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:17.236925 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4e0af-098f-477b-960a-0dc8ee36f3ce admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:17.282078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cc189-53bd-46d3-abf2-ee6a4e774352 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:17.358109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b08e19-a3de-48bd-b21b-1e62ed266428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:17.359071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b08e19-a3de-48bd-b21b-1e62ed266428 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:17.359507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b08e19-a3de-48bd-b21b-1e62ed266428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:17.360164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b08e19-a3de-48bd-b21b-1e62ed266428 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:17.361099 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b08e19-a3de-48bd-b21b-1e62ed266428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:17.363651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b08e19-a3de-48bd-b21b-1e62ed266428 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:17.455900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4e0af-098f-477b-960a-0dc8ee36f3ce admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:17.473729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fc2fb-0c6c-42bf-9395-c13858f0e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:17.474277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 894/1805] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:17 2022] POST /identity/v3/users => generated 294 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:17.474436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc2fb-0c6c-42bf-9395-c13858f0e676 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:17.475498 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc2fb-0c6c-42bf-9395-c13858f0e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:17.475804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc2fb-0c6c-42bf-9395-c13858f0e676 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:17.476529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fc2fb-0c6c-42bf-9395-c13858f0e676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:17.480562 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fc2fb-0c6c-42bf-9395-c13858f0e676 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:17.480830 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b08e19-a3de-48bd-b21b-1e62ed266428 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:17.503965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b08e19-a3de-48bd-b21b-1e62ed266428 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:17.510645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdfdab-0379-478f-a578-0068a1c6df35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:17.511605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdfdab-0379-478f-a578-0068a1c6df35 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:17.512027 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdfdab-0379-478f-a578-0068a1c6df35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:17.513316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdfdab-0379-478f-a578-0068a1c6df35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:17.514433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdfdab-0379-478f-a578-0068a1c6df35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:17.516923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdfdab-0379-478f-a578-0068a1c6df35 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:17.533261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 895/1806] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:17.534411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdfdab-0379-478f-a578-0068a1c6df35 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:17.537513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b6fdfdab-0379-478f-a578-0068a1c6df35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:17.555333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdfdab-0379-478f-a578-0068a1c6df35 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:17.563375 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:17.565679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:17.565679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:17.565679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] PATH_INFO: `/v3/projects/eb1945a000d7427cb02f474de9c2f366` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:17.566885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1945a000d7427cb02f474de9c2f366)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:17.569213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:17.605015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 912/1807] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:17 2022] POST /identity/v3/users => generated 295 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:17.610338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fc2fb-0c6c-42bf-9395-c13858f0e676 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:17.632913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fc2fb-0c6c-42bf-9395-c13858f0e676 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:17.649658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5c52-3395-4013-9eda-e4f698811e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:17.650740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5c52-3395-4013-9eda-e4f698811e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:17.651168 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5c52-3395-4013-9eda-e4f698811e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:17.651740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5c52-3395-4013-9eda-e4f698811e3f admin admin] PATH_INFO: `/v3/projects/43712cd95c95454fa36cab3a47508191/users/3da3974f91484619934840562cce5724/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:17.694641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5c52-3395-4013-9eda-e4f698811e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43712cd95c95454fa36cab3a47508191, user_id=3da3974f91484619934840562cce5724, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:17.697356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5c52-3395-4013-9eda-e4f698811e3f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:17.835981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 913/1808] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:17 2022] PUT /identity/v3/projects/43712cd95c95454fa36cab3a47508191/users/3da3974f91484619934840562cce5724/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:17.837366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5c52-3395-4013-9eda-e4f698811e3f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:17.849175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1945a000d7427cb02f474de9c2f366', 'request_id': 'req-88a7ecd7-7fe6-4ea7-9913-745459647661'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:17.913011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5c52-3395-4013-9eda-e4f698811e3f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:17.929905 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1945a000d7427cb02f474de9c2f366', 'request_id': 'req-88a7ecd7-7fe6-4ea7-9913-745459647661'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:17.952775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1945a000d7427cb02f474de9c2f366', 'request_id': 'req-88a7ecd7-7fe6-4ea7-9913-745459647661'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:17.977414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] The token cache is being invalidate because project eb1945a000d7427cb02f474de9c2f366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:17.977893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:17.978773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:17.981621 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 896/1809] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:17 2022] DELETE /identity/v3/projects/eb1945a000d7427cb02f474de9c2f366 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:17.983219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:17.985100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:18.086268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e13f0d-d283-4291-8f1f-ac6e716d4fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:18.087894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7ecd7-7fe6-4ea7-9913-745459647661 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:18.089051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e13f0d-d283-4291-8f1f-ac6e716d4fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:18.092201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e13f0d-d283-4291-8f1f-ac6e716d4fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:18.092740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e13f0d-d283-4291-8f1f-ac6e716d4fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:18.105477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e13f0d-d283-4291-8f1f-ac6e716d4fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:18.111516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e13f0d-d283-4291-8f1f-ac6e716d4fdf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:18.125429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d32d7-f47a-4d36-9449-ee400eec4c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:18.127900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d32d7-f47a-4d36-9449-ee400eec4c67 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:18.133841 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d32d7-f47a-4d36-9449-ee400eec4c67 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:18.134228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d32d7-f47a-4d36-9449-ee400eec4c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:18.139201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d72d32d7-f47a-4d36-9449-ee400eec4c67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:18.149821 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 914/1810] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:18.151722 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426e6c-c3ec-4b52-a8e3-83a71346cada None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:18.152023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426e6c-c3ec-4b52-a8e3-83a71346cada None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:18.152308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426e6c-c3ec-4b52-a8e3-83a71346cada None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:18.156433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 915/1811] 10.222.0.61 () {54 vars in 921 bytes} [Tue Apr 12 14:26:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:26:18.157626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea426e6c-c3ec-4b52-a8e3-83a71346cada None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:18.160022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ea426e6c-c3ec-4b52-a8e3-83a71346cada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:18.181733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea426e6c-c3ec-4b52-a8e3-83a71346cada None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:18.182317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d32d7-f47a-4d36-9449-ee400eec4c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:18.187757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb6fdb-53c6-40cc-868c-839d459a6858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:18.188425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6fdb-53c6-40cc-868c-839d459a6858 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:18.188657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6fdb-53c6-40cc-868c-839d459a6858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:18.188937 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6fdb-53c6-40cc-868c-839d459a6858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:18.189853 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb6fdb-53c6-40cc-868c-839d459a6858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:18.191805 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb6fdb-53c6-40cc-868c-839d459a6858 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:18.193383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d32d7-f47a-4d36-9449-ee400eec4c67 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:18.217551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 916/1812] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:18.218586 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb6fdb-53c6-40cc-868c-839d459a6858 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:18.218915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 897/1813] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:18.220390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d32d7-f47a-4d36-9449-ee400eec4c67 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:18.221887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-17fb6fdb-53c6-40cc-868c-839d459a6858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:18.222783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d72d32d7-f47a-4d36-9449-ee400eec4c67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:18.244912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d32d7-f47a-4d36-9449-ee400eec4c67 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:18.250349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb6fdb-53c6-40cc-868c-839d459a6858 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:18.250482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2bd9d-c0dc-48a9-836e-bfde89c91808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:18.253345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2bd9d-c0dc-48a9-836e-bfde89c91808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:18.253345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2bd9d-c0dc-48a9-836e-bfde89c91808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:18.253345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2bd9d-c0dc-48a9-836e-bfde89c91808 admin admin] PATH_INFO: `/v3/projects/159a75349ea642ad82ce691432966d95/users/1504d8114b884dff8601b7318c21dc9a/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:18.263278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bef144-d0cb-45f7-abf1-51c3a81b20d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:18.264406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bef144-d0cb-45f7-abf1-51c3a81b20d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:18.264693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bef144-d0cb-45f7-abf1-51c3a81b20d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:18.264986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bef144-d0cb-45f7-abf1-51c3a81b20d7 admin admin] PATH_INFO: `/v3/users/f60dc040ddc44231a1de123f1fba772d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:18.272358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bef144-d0cb-45f7-abf1-51c3a81b20d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60dc040ddc44231a1de123f1fba772d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:18.274358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bef144-d0cb-45f7-abf1-51c3a81b20d7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:18.277508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2bd9d-c0dc-48a9-836e-bfde89c91808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159a75349ea642ad82ce691432966d95, user_id=1504d8114b884dff8601b7318c21dc9a, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:18.282892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2bd9d-c0dc-48a9-836e-bfde89c91808 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:18.388277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 898/1814] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:18 2022] PUT /identity/v3/projects/159a75349ea642ad82ce691432966d95/users/1504d8114b884dff8601b7318c21dc9a/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:18.388277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722514ba-f3b4-4f35-be15-449e9387d418 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:18.388277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722514ba-f3b4-4f35-be15-449e9387d418 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:18.388277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722514ba-f3b4-4f35-be15-449e9387d418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:18.421945 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-722514ba-f3b4-4f35-be15-449e9387d418 None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:18.423283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-722514ba-f3b4-4f35-be15-449e9387d418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:18.561246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 899/1815] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Apr 12 14:26:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:18.563962 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722514ba-f3b4-4f35-be15-449e9387d418 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:18.726245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722514ba-f3b4-4f35-be15-449e9387d418 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:18.734094 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28898bcb-0b1c-41d9-8c96-f4057ef34e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:18.734753 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28898bcb-0b1c-41d9-8c96-f4057ef34e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:18.735231 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28898bcb-0b1c-41d9-8c96-f4057ef34e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:18.735512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28898bcb-0b1c-41d9-8c96-f4057ef34e72 admin admin] PATH_INFO: `/v3/projects/43712cd95c95454fa36cab3a47508191/users/3da3974f91484619934840562cce5724/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:18.738745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28898bcb-0b1c-41d9-8c96-f4057ef34e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43712cd95c95454fa36cab3a47508191, user_id=3da3974f91484619934840562cce5724, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:18.752211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28898bcb-0b1c-41d9-8c96-f4057ef34e72 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:18.798823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0bef144-d0cb-45f7-abf1-51c3a81b20d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60dc040ddc44231a1de123f1fba772d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:18.809966 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 900/1816] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:18 2022] PUT /identity/v3/projects/43712cd95c95454fa36cab3a47508191/users/3da3974f91484619934840562cce5724/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:18.811664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28898bcb-0b1c-41d9-8c96-f4057ef34e72 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:18.835548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0bef144-d0cb-45f7-abf1-51c3a81b20d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60dc040ddc44231a1de123f1fba772d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:18.936749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28898bcb-0b1c-41d9-8c96-f4057ef34e72 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:18.941773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab0de-465f-4fdf-8515-743a8561da54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:18.942624 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab0de-465f-4fdf-8515-743a8561da54 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:18.942911 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab0de-465f-4fdf-8515-743a8561da54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:18.943189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab0de-465f-4fdf-8515-743a8561da54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:18.943918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab0de-465f-4fdf-8515-743a8561da54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:18.945588 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab0de-465f-4fdf-8515-743a8561da54 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:18.956280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0bef144-d0cb-45f7-abf1-51c3a81b20d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60dc040ddc44231a1de123f1fba772d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:18.957399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 901/1817] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:18.958322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab0de-465f-4fdf-8515-743a8561da54 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:18.966470 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0bef144-d0cb-45f7-abf1-51c3a81b20d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60dc040ddc44231a1de123f1fba772d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:18.973378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0bef144-d0cb-45f7-abf1-51c3a81b20d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60dc040ddc44231a1de123f1fba772d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:18.983620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 917/1818] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:18 2022] DELETE /identity/v3/users/f60dc040ddc44231a1de123f1fba772d => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:18.985578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa977d9-1872-4a87-ad95-340dda56af87 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:18.986105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa977d9-1872-4a87-ad95-340dda56af87 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:18.986675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa977d9-1872-4a87-ad95-340dda56af87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:19.017539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-efa977d9-1872-4a87-ad95-340dda56af87 None None] MFA Rules not processed for user `3da3974f91484619934840562cce5724`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:19.019306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-efa977d9-1872-4a87-ad95-340dda56af87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:19.098151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab0de-465f-4fdf-8515-743a8561da54 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:19.131175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 918/1819] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:19.133530 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa977d9-1872-4a87-ad95-340dda56af87 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:19.136520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-efa977d9-1872-4a87-ad95-340dda56af87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:19.202749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa053a-2b2e-46c8-ab29-5e60b920bd54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:19.203910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa053a-2b2e-46c8-ab29-5e60b920bd54 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:19.204525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa053a-2b2e-46c8-ab29-5e60b920bd54 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:19.204877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa053a-2b2e-46c8-ab29-5e60b920bd54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:19.208850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bcaa053a-2b2e-46c8-ab29-5e60b920bd54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:19.235350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa053a-2b2e-46c8-ab29-5e60b920bd54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:19.239497 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa053a-2b2e-46c8-ab29-5e60b920bd54 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:19.262841 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 902/1820] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:19.263872 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa053a-2b2e-46c8-ab29-5e60b920bd54 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:19.265790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bcaa053a-2b2e-46c8-ab29-5e60b920bd54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:19.288017 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa977d9-1872-4a87-ad95-340dda56af87 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:19.310191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc38d17-062d-4891-bd70-6c26cb66c5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:19.311141 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38d17-062d-4891-bd70-6c26cb66c5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:19.312980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38d17-062d-4891-bd70-6c26cb66c5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:19.312980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38d17-062d-4891-bd70-6c26cb66c5f3 admin admin] PATH_INFO: `/v3/projects/159a75349ea642ad82ce691432966d95/users/1504d8114b884dff8601b7318c21dc9a/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:19.315975 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc38d17-062d-4891-bd70-6c26cb66c5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159a75349ea642ad82ce691432966d95, user_id=1504d8114b884dff8601b7318c21dc9a, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:19.319329 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc38d17-062d-4891-bd70-6c26cb66c5f3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:19.345520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 919/1821] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:19 2022] PUT /identity/v3/projects/159a75349ea642ad82ce691432966d95/users/1504d8114b884dff8601b7318c21dc9a/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:19.355616 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f2e20-7d3f-4941-9b73-9a7d26409ae7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:19.357131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f2e20-7d3f-4941-9b73-9a7d26409ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:19.362597 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f2e20-7d3f-4941-9b73-9a7d26409ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:19.433475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa053a-2b2e-46c8-ab29-5e60b920bd54 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:19.437436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-717f2e20-7d3f-4941-9b73-9a7d26409ae7 None None] MFA Rules not processed for user `1504d8114b884dff8601b7318c21dc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:19.439195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-717f2e20-7d3f-4941-9b73-9a7d26409ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:19.544303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 920/1822] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:19.556142 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7719f-3f3f-4020-879f-f48a698c4118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:19.556805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7719f-3f3f-4020-879f-f48a698c4118 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:19.557183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7719f-3f3f-4020-879f-f48a698c4118 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:19.557457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7719f-3f3f-4020-879f-f48a698c4118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:19.561272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ecb7719f-3f3f-4020-879f-f48a698c4118 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:19.638058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7719f-3f3f-4020-879f-f48a698c4118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:19.639915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7719f-3f3f-4020-879f-f48a698c4118 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:19.651433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 903/1823] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:19.852770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f2e20-7d3f-4941-9b73-9a7d26409ae7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:19.855454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-717f2e20-7d3f-4941-9b73-9a7d26409ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:19.869323 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f2e20-7d3f-4941-9b73-9a7d26409ae7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:19.873610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96450a7c-5f17-4cb9-b043-224787784838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:19.877191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96450a7c-5f17-4cb9-b043-224787784838 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:19.881187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96450a7c-5f17-4cb9-b043-224787784838 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:19.882632 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96450a7c-5f17-4cb9-b043-224787784838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:19.902696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96450a7c-5f17-4cb9-b043-224787784838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:19.905820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96450a7c-5f17-4cb9-b043-224787784838 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:19.919237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 921/1824] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:20.203667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7719f-3f3f-4020-879f-f48a698c4118 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:20.218602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7719f-3f3f-4020-879f-f48a698c4118 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:20.245238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039676f-0cb0-4c82-8d8a-611256160011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:20.245238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039676f-0cb0-4c82-8d8a-611256160011 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:20.245238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039676f-0cb0-4c82-8d8a-611256160011 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:20.245238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039676f-0cb0-4c82-8d8a-611256160011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:20.249976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4039676f-0cb0-4c82-8d8a-611256160011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:20.266197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96450a7c-5f17-4cb9-b043-224787784838 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:20.268330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-96450a7c-5f17-4cb9-b043-224787784838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:20.404548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039676f-0cb0-4c82-8d8a-611256160011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:20.406913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039676f-0cb0-4c82-8d8a-611256160011 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:20.421904 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 904/1825] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:20.426038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96450a7c-5f17-4cb9-b043-224787784838 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:20.432384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:20.433604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:20.434028 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:20.434986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] PATH_INFO: `/v3/projects/690c1de21d204bff9da7e65d38f3610e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:20.436694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=690c1de21d204bff9da7e65d38f3610e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:20.439092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:20.608950 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690c1de21d204bff9da7e65d38f3610e', 'request_id': 'req-5d101a1d-5422-441a-add0-13da16d73b6f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:20.724654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690c1de21d204bff9da7e65d38f3610e', 'request_id': 'req-5d101a1d-5422-441a-add0-13da16d73b6f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:20.735250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690c1de21d204bff9da7e65d38f3610e', 'request_id': 'req-5d101a1d-5422-441a-add0-13da16d73b6f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:20.764235 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] The token cache is being invalidate because project 690c1de21d204bff9da7e65d38f3610e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:20.764668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:20.766789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d101a1d-5422-441a-add0-13da16d73b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:20.777182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 922/1826] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:20 2022] DELETE /identity/v3/projects/690c1de21d204bff9da7e65d38f3610e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:20.781296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb01f41-4d6b-400d-ba1e-f482f514a57a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:20.781812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb01f41-4d6b-400d-ba1e-f482f514a57a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:20.782288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb01f41-4d6b-400d-ba1e-f482f514a57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:20.846850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9eb01f41-4d6b-400d-ba1e-f482f514a57a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:20.848167 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9eb01f41-4d6b-400d-ba1e-f482f514a57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:20.942370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 905/1827] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:20.951550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca798-af6f-4eab-bf24-6fe1baf08c06 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:20.952036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca798-af6f-4eab-bf24-6fe1baf08c06 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:20.952122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca798-af6f-4eab-bf24-6fe1baf08c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:20.970496 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-98fca798-af6f-4eab-bf24-6fe1baf08c06 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:20.971686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-98fca798-af6f-4eab-bf24-6fe1baf08c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:20.979902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 923/1828] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:20.985130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb01f41-4d6b-400d-ba1e-f482f514a57a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:20.995844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb01f41-4d6b-400d-ba1e-f482f514a57a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:21.001660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091bc72-1f38-43e3-8dc5-74c9d0575128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:21.002325 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091bc72-1f38-43e3-8dc5-74c9d0575128 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:21.002609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091bc72-1f38-43e3-8dc5-74c9d0575128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:21.002884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091bc72-1f38-43e3-8dc5-74c9d0575128 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:21.003805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091bc72-1f38-43e3-8dc5-74c9d0575128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:21.004000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091bc72-1f38-43e3-8dc5-74c9d0575128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:21.005824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091bc72-1f38-43e3-8dc5-74c9d0575128 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:21.023549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 906/1829] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:21.028770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca798-af6f-4eab-bf24-6fe1baf08c06 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:21.038909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca798-af6f-4eab-bf24-6fe1baf08c06 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:21.044208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552755e-a5a3-4149-8512-df7e3e1b9bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:21.045304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552755e-a5a3-4149-8512-df7e3e1b9bba admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:21.045592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552755e-a5a3-4149-8512-df7e3e1b9bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:21.045861 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552755e-a5a3-4149-8512-df7e3e1b9bba admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:21.049070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552755e-a5a3-4149-8512-df7e3e1b9bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:21.049070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552755e-a5a3-4149-8512-df7e3e1b9bba admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:21.136945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 924/1830] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:21 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:21.141894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091bc72-1f38-43e3-8dc5-74c9d0575128 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:21.151928 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091bc72-1f38-43e3-8dc5-74c9d0575128 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:21.209055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dcb5d-88cd-478c-84df-9a1d81a775ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:21.209820 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dcb5d-88cd-478c-84df-9a1d81a775ae admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:21.210186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dcb5d-88cd-478c-84df-9a1d81a775ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:21.210312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dcb5d-88cd-478c-84df-9a1d81a775ae admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:21.210968 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dcb5d-88cd-478c-84df-9a1d81a775ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:21.212854 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dcb5d-88cd-478c-84df-9a1d81a775ae admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:21.325606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 907/1831] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:21 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:21.327644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552755e-a5a3-4149-8512-df7e3e1b9bba admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:21.348562 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552755e-a5a3-4149-8512-df7e3e1b9bba admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:21.359928 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b22dcf-c2db-4e1c-9933-929ed74c642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:21.361152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b22dcf-c2db-4e1c-9933-929ed74c642d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:21.361681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b22dcf-c2db-4e1c-9933-929ed74c642d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:21.362328 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b22dcf-c2db-4e1c-9933-929ed74c642d admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:21.363394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b22dcf-c2db-4e1c-9933-929ed74c642d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:21.365271 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b22dcf-c2db-4e1c-9933-929ed74c642d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:21.385963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 925/1832] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:21.390768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dcb5d-88cd-478c-84df-9a1d81a775ae admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:21.401404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dcb5d-88cd-478c-84df-9a1d81a775ae admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:21.409144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabb4bf-1fd9-4108-9037-5e0c84b4d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:21.410079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabb4bf-1fd9-4108-9037-5e0c84b4d542 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:21.410183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabb4bf-1fd9-4108-9037-5e0c84b4d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:21.410452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabb4bf-1fd9-4108-9037-5e0c84b4d542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:21.411199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabb4bf-1fd9-4108-9037-5e0c84b4d542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:21.412867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabb4bf-1fd9-4108-9037-5e0c84b4d542 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:21.440631 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 908/1833] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:21.442618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b22dcf-c2db-4e1c-9933-929ed74c642d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:21.470874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b22dcf-c2db-4e1c-9933-929ed74c642d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:21.475641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45fc11-1375-472d-9a50-cadd9ec059cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:21.476537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45fc11-1375-472d-9a50-cadd9ec059cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:21.476844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45fc11-1375-472d-9a50-cadd9ec059cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:21.477293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45fc11-1375-472d-9a50-cadd9ec059cc admin admin] PATH_INFO: `/v3/projects/c6d711e8fa9d47238b7c469830c407a5/users/cc966f1863b64091b07b794d1fe7e385/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:21.510728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45fc11-1375-472d-9a50-cadd9ec059cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d711e8fa9d47238b7c469830c407a5, user_id=cc966f1863b64091b07b794d1fe7e385, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:21.514002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45fc11-1375-472d-9a50-cadd9ec059cc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:21.643694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 926/1834] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:21 2022] PUT /identity/v3/projects/c6d711e8fa9d47238b7c469830c407a5/users/cc966f1863b64091b07b794d1fe7e385/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:21.654603 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090fcb5-2bb3-41f4-9979-18a8985b6d8a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:21.654894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090fcb5-2bb3-41f4-9979-18a8985b6d8a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:21.655176 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090fcb5-2bb3-41f4-9979-18a8985b6d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:21.700700 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9090fcb5-2bb3-41f4-9979-18a8985b6d8a None None] MFA Rules not processed for user `cc966f1863b64091b07b794d1fe7e385`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:21.702131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9090fcb5-2bb3-41f4-9979-18a8985b6d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:21.881581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 909/1835] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:21.886429 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45fc11-1375-472d-9a50-cadd9ec059cc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:22.018727 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45fc11-1375-472d-9a50-cadd9ec059cc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:22.025231 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677a5d9-49a4-4ff4-bffe-0ba4fe09eb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:22.026120 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677a5d9-49a4-4ff4-bffe-0ba4fe09eb2f admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:22.026477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677a5d9-49a4-4ff4-bffe-0ba4fe09eb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:22.026824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677a5d9-49a4-4ff4-bffe-0ba4fe09eb2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:22.027602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677a5d9-49a4-4ff4-bffe-0ba4fe09eb2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:22.030470 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677a5d9-49a4-4ff4-bffe-0ba4fe09eb2f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:22.177230 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 927/1836] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:21 2022] POST /identity/v3/projects => generated 365 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:22.180244 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090fcb5-2bb3-41f4-9979-18a8985b6d8a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:22.191967 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090fcb5-2bb3-41f4-9979-18a8985b6d8a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:22.252955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdd3ca-f375-424c-89b2-0b6675a0dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:22.253666 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd3ca-f375-424c-89b2-0b6675a0dd11 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:22.253934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd3ca-f375-424c-89b2-0b6675a0dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:22.254209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd3ca-f375-424c-89b2-0b6675a0dd11 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:22.254913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdd3ca-f375-424c-89b2-0b6675a0dd11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:22.256858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdd3ca-f375-424c-89b2-0b6675a0dd11 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:22.346505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 910/1837] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:22 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:22.350557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677a5d9-49a4-4ff4-bffe-0ba4fe09eb2f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:22.361711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677a5d9-49a4-4ff4-bffe-0ba4fe09eb2f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:22.366484 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40915a57-dc94-4f0c-998b-38c2dd9465c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:22.367168 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40915a57-dc94-4f0c-998b-38c2dd9465c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:22.367457 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40915a57-dc94-4f0c-998b-38c2dd9465c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:22.367739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40915a57-dc94-4f0c-998b-38c2dd9465c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:22.368459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40915a57-dc94-4f0c-998b-38c2dd9465c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:22.370155 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40915a57-dc94-4f0c-998b-38c2dd9465c6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:22.380702 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 928/1838] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:22.385173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdd3ca-f375-424c-89b2-0b6675a0dd11 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:22.395299 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdd3ca-f375-424c-89b2-0b6675a0dd11 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:22.399853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd53c02-3025-4c4e-9b1d-58ae6455457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:22.400725 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd53c02-3025-4c4e-9b1d-58ae6455457b admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:22.401047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd53c02-3025-4c4e-9b1d-58ae6455457b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:22.401322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd53c02-3025-4c4e-9b1d-58ae6455457b admin admin] PATH_INFO: `/v3/projects/4f6b7aeb9d2a4f7ba510050d0742b134/users/dda8131fa2344ed0a6db5d7f209803f6/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:22.416207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd53c02-3025-4c4e-9b1d-58ae6455457b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6b7aeb9d2a4f7ba510050d0742b134, user_id=dda8131fa2344ed0a6db5d7f209803f6, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:22.420123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd53c02-3025-4c4e-9b1d-58ae6455457b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:22.505828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 911/1839] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:22 2022] PUT /identity/v3/projects/4f6b7aeb9d2a4f7ba510050d0742b134/users/dda8131fa2344ed0a6db5d7f209803f6/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:22.512820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40915a57-dc94-4f0c-998b-38c2dd9465c6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:22.520882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40915a57-dc94-4f0c-998b-38c2dd9465c6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:22.582652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7fe2e-ef91-4139-9f01-efec2ee20932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:22.583395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7fe2e-ef91-4139-9f01-efec2ee20932 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:22.583760 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7fe2e-ef91-4139-9f01-efec2ee20932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:22.584221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7fe2e-ef91-4139-9f01-efec2ee20932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:22.584978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7fe2e-ef91-4139-9f01-efec2ee20932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:22.586585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7fe2e-ef91-4139-9f01-efec2ee20932 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:22.597918 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 929/1840] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:22.602276 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd53c02-3025-4c4e-9b1d-58ae6455457b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:22.614374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd53c02-3025-4c4e-9b1d-58ae6455457b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:22.619343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825586d-13a9-48cd-8a6f-3b016683f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:22.620329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825586d-13a9-48cd-8a6f-3b016683f238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:22.620954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825586d-13a9-48cd-8a6f-3b016683f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:22.621377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825586d-13a9-48cd-8a6f-3b016683f238 admin admin] PATH_INFO: `/v3/projects/4f6b7aeb9d2a4f7ba510050d0742b134/users/dda8131fa2344ed0a6db5d7f209803f6/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:22.623715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825586d-13a9-48cd-8a6f-3b016683f238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6b7aeb9d2a4f7ba510050d0742b134, user_id=dda8131fa2344ed0a6db5d7f209803f6, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:22.626469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825586d-13a9-48cd-8a6f-3b016683f238 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:22.638427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 912/1841] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:22 2022] PUT /identity/v3/projects/4f6b7aeb9d2a4f7ba510050d0742b134/users/dda8131fa2344ed0a6db5d7f209803f6/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:22.650770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a731b3-2bf6-4679-8aba-ce872763d132 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:22.651062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a731b3-2bf6-4679-8aba-ce872763d132 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:22.651365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a731b3-2bf6-4679-8aba-ce872763d132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:22.684647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-27a731b3-2bf6-4679-8aba-ce872763d132 None None] MFA Rules not processed for user `dda8131fa2344ed0a6db5d7f209803f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:22.686130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-27a731b3-2bf6-4679-8aba-ce872763d132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:22.768991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 930/1842] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:22.781192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825586d-13a9-48cd-8a6f-3b016683f238 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:22.783953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f825586d-13a9-48cd-8a6f-3b016683f238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:22.865468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825586d-13a9-48cd-8a6f-3b016683f238 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:22.865468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148ee5f-12ec-4eb0-a46b-9d2ea1dd33a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:22.865468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ee5f-12ec-4eb0-a46b-9d2ea1dd33a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:22.865468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ee5f-12ec-4eb0-a46b-9d2ea1dd33a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:22.865924 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ee5f-12ec-4eb0-a46b-9d2ea1dd33a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:22.868107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148ee5f-12ec-4eb0-a46b-9d2ea1dd33a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:22.869605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148ee5f-12ec-4eb0-a46b-9d2ea1dd33a2 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:22.880379 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 913/1843] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:23.376914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a731b3-2bf6-4679-8aba-ce872763d132 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:23.379159 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-27a731b3-2bf6-4679-8aba-ce872763d132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:23.457046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a731b3-2bf6-4679-8aba-ce872763d132 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:23.462255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:23.466070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:23.466070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:23.466070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] PATH_INFO: `/v3/users/ac6cc188a66e45d3bd6226b8e423d303` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:23.466070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6cc188a66e45d3bd6226b8e423d303)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:23.467276 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:23.801310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6cc188a66e45d3bd6226b8e423d303'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:23.833362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6cc188a66e45d3bd6226b8e423d303'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:23.934915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6cc188a66e45d3bd6226b8e423d303'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:23.959337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6cc188a66e45d3bd6226b8e423d303'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:23.960093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6cc188a66e45d3bd6226b8e423d303'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:23.980183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 931/1844] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:23 2022] DELETE /identity/v3/users/ac6cc188a66e45d3bd6226b8e423d303 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:23.985608 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46aba4-5e49-4bfa-b5af-410871137889 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:23.986129 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46aba4-5e49-4bfa-b5af-410871137889 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:23.986220 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46aba4-5e49-4bfa-b5af-410871137889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:24.015371 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8e46aba4-5e49-4bfa-b5af-410871137889 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:24.019161 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8e46aba4-5e49-4bfa-b5af-410871137889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:24.141100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 914/1845] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:24.167247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:24.174415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:24.279099 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b075d1-f35b-414b-9480-682b2a6523d8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:24.282802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e65f9-8f2f-416e-8585-5d26b7542906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:24.283544 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e65f9-8f2f-416e-8585-5d26b7542906 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:24.283849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e65f9-8f2f-416e-8585-5d26b7542906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:24.284150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e65f9-8f2f-416e-8585-5d26b7542906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:24.295440 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e65f9-8f2f-416e-8585-5d26b7542906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:24.296900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e65f9-8f2f-416e-8585-5d26b7542906 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:24.311767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 932/1846] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:24.323633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46aba4-5e49-4bfa-b5af-410871137889 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:24.326176 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8e46aba4-5e49-4bfa-b5af-410871137889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:24.342791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46aba4-5e49-4bfa-b5af-410871137889 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:24.347861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:24.348922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:24.349247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:24.349525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] PATH_INFO: `/v3/users/cc966f1863b64091b07b794d1fe7e385` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:24.350806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc966f1863b64091b07b794d1fe7e385)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:24.352813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:24.564339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc966f1863b64091b07b794d1fe7e385'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:24.577022 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc966f1863b64091b07b794d1fe7e385'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:24.577805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc966f1863b64091b07b794d1fe7e385'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:24.584394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc966f1863b64091b07b794d1fe7e385'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:24.585038 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc966f1863b64091b07b794d1fe7e385'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:24.674163 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fade88-4ec0-43d2-bce2-5804cfe01b76 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:24.674163 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fade88-4ec0-43d2-bce2-5804cfe01b76 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:24.674163 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fade88-4ec0-43d2-bce2-5804cfe01b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:24.674711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 915/1847] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:24 2022] DELETE /identity/v3/users/cc966f1863b64091b07b794d1fe7e385 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:24.691602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-46fade88-4ec0-43d2-bce2-5804cfe01b76 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:24.692851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-46fade88-4ec0-43d2-bce2-5804cfe01b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:24.768659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 933/1848] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:24.781402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:24.783093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:24.857741 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc975b-289f-4388-a1ac-68afa237ccfc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:24.861490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c6952-f0f1-453d-8a24-f2a07db239b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:24.862152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c6952-f0f1-453d-8a24-f2a07db239b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:24.862458 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c6952-f0f1-453d-8a24-f2a07db239b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:24.862732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c6952-f0f1-453d-8a24-f2a07db239b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:24.882969 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c6952-f0f1-453d-8a24-f2a07db239b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:24.883764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c6952-f0f1-453d-8a24-f2a07db239b9 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:24.897162 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 916/1849] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:25.065081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fade88-4ec0-43d2-bce2-5804cfe01b76 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:25.067164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-46fade88-4ec0-43d2-bce2-5804cfe01b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:25.095425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fade88-4ec0-43d2-bce2-5804cfe01b76 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:25.113435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:25.114663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:25.115179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:25.115641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] PATH_INFO: `/v3/projects/b241d161dcbf4605ab30e2a65efbb65f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:25.117658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b241d161dcbf4605ab30e2a65efbb65f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:25.120664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:25.293486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b241d161dcbf4605ab30e2a65efbb65f', 'request_id': 'req-5cdf6043-4af2-4f6f-b470-f33e7341e035'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:25.376291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c6952-f0f1-453d-8a24-f2a07db239b9 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:25.379577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b36c6952-f0f1-453d-8a24-f2a07db239b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:25.397292 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c6952-f0f1-453d-8a24-f2a07db239b9 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:25.409843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b241d161dcbf4605ab30e2a65efbb65f', 'request_id': 'req-5cdf6043-4af2-4f6f-b470-f33e7341e035'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:25.419351 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b241d161dcbf4605ab30e2a65efbb65f', 'request_id': 'req-5cdf6043-4af2-4f6f-b470-f33e7341e035'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:25.445488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] The token cache is being invalidate because project b241d161dcbf4605ab30e2a65efbb65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:25.445852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:25.447263 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:25.451872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 934/1850] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:25 2022] DELETE /identity/v3/projects/b241d161dcbf4605ab30e2a65efbb65f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:25.455646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:25.457308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:25.499935 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:25.500940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:25.501424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:25.501721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] PATH_INFO: `/v3/users/02788c1df7af402782640515be4442f4` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:25.503261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=02788c1df7af402782640515be4442f4)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:25.505252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:25.549593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf6043-4af2-4f6f-b470-f33e7341e035 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:25.555260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10058-2769-484f-a70c-1ac2f8908d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:25.556237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10058-2769-484f-a70c-1ac2f8908d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:25.570545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10058-2769-484f-a70c-1ac2f8908d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:25.570545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10058-2769-484f-a70c-1ac2f8908d89 admin admin] PATH_INFO: `/v3/users/3da3974f91484619934840562cce5724` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:25.570545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e10058-2769-484f-a70c-1ac2f8908d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da3974f91484619934840562cce5724)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:25.570545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e10058-2769-484f-a70c-1ac2f8908d89 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:25.826863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02788c1df7af402782640515be4442f4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:25.842512 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02788c1df7af402782640515be4442f4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:25.843383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02788c1df7af402782640515be4442f4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:25.853987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02788c1df7af402782640515be4442f4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:25.855764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02788c1df7af402782640515be4442f4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:25.969986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 917/1851] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:25 2022] DELETE /identity/v3/users/02788c1df7af402782640515be4442f4 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:25.970782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97e10058-2769-484f-a70c-1ac2f8908d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da3974f91484619934840562cce5724'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:25.971309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:25.974665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:25.988567 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97e10058-2769-484f-a70c-1ac2f8908d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da3974f91484619934840562cce5724'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.089010 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d9554-c246-4bee-a3b4-ccb8245b5b3d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:26.101673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:26.102580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:26.102863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:26.103143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] PATH_INFO: `/v3/projects/c6d711e8fa9d47238b7c469830c407a5` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:26.105303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97e10058-2769-484f-a70c-1ac2f8908d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da3974f91484619934840562cce5724'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.108606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d711e8fa9d47238b7c469830c407a5)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:26.110160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:26.116668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97e10058-2769-484f-a70c-1ac2f8908d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da3974f91484619934840562cce5724'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.117614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97e10058-2769-484f-a70c-1ac2f8908d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da3974f91484619934840562cce5724'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.130651 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 935/1852] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:25 2022] DELETE /identity/v3/users/3da3974f91484619934840562cce5724 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:26.132504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719b252-8a03-497c-8813-cdf706ddcf9a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:26.132979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719b252-8a03-497c-8813-cdf706ddcf9a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:26.154078 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719b252-8a03-497c-8813-cdf706ddcf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:26.189989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9719b252-8a03-497c-8813-cdf706ddcf9a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:26.194465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9719b252-8a03-497c-8813-cdf706ddcf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:26.311881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d711e8fa9d47238b7c469830c407a5', 'request_id': 'req-d5ef7ec2-c588-4ca6-8f9a-da96de544822'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.365171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 936/1853] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:26.377824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719b252-8a03-497c-8813-cdf706ddcf9a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:26.380009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9719b252-8a03-497c-8813-cdf706ddcf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:26.395963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d711e8fa9d47238b7c469830c407a5', 'request_id': 'req-d5ef7ec2-c588-4ca6-8f9a-da96de544822'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.404474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d711e8fa9d47238b7c469830c407a5', 'request_id': 'req-d5ef7ec2-c588-4ca6-8f9a-da96de544822'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.415271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] The token cache is being invalidate because project c6d711e8fa9d47238b7c469830c407a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:26.415784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.416634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.418245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 918/1854] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:25 2022] DELETE /identity/v3/projects/c6d711e8fa9d47238b7c469830c407a5 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:26.422789 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:26.435692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:26.509219 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719b252-8a03-497c-8813-cdf706ddcf9a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:26.542004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef7ec2-c588-4ca6-8f9a-da96de544822 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:26.548489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16c626-4dbf-4e84-a755-7c9235974bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:26.549557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16c626-4dbf-4e84-a755-7c9235974bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:26.555075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16c626-4dbf-4e84-a755-7c9235974bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:26.555075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16c626-4dbf-4e84-a755-7c9235974bc2 admin admin] PATH_INFO: `/v3/users/dda8131fa2344ed0a6db5d7f209803f6` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:26.555075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16c626-4dbf-4e84-a755-7c9235974bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda8131fa2344ed0a6db5d7f209803f6)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:26.555075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16c626-4dbf-4e84-a755-7c9235974bc2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:26.574183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e195a1f-ba25-4d63-bd6a-98bb3e72717c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:26.574882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195a1f-ba25-4d63-bd6a-98bb3e72717c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:26.575166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195a1f-ba25-4d63-bd6a-98bb3e72717c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:26.575523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195a1f-ba25-4d63-bd6a-98bb3e72717c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:26.577617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8e195a1f-ba25-4d63-bd6a-98bb3e72717c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:26.592951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e195a1f-ba25-4d63-bd6a-98bb3e72717c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:26.594520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e195a1f-ba25-4d63-bd6a-98bb3e72717c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:26.610310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 937/1855] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:26:26.866938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4f16c626-4dbf-4e84-a755-7c9235974bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda8131fa2344ed0a6db5d7f209803f6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.928578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4f16c626-4dbf-4e84-a755-7c9235974bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda8131fa2344ed0a6db5d7f209803f6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.930032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4f16c626-4dbf-4e84-a755-7c9235974bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda8131fa2344ed0a6db5d7f209803f6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.940220 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4f16c626-4dbf-4e84-a755-7c9235974bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda8131fa2344ed0a6db5d7f209803f6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.941632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4f16c626-4dbf-4e84-a755-7c9235974bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda8131fa2344ed0a6db5d7f209803f6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:26.958944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e195a1f-ba25-4d63-bd6a-98bb3e72717c service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:26.960408 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8e195a1f-ba25-4d63-bd6a-98bb3e72717c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:26.973079 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e195a1f-ba25-4d63-bd6a-98bb3e72717c service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:26.979204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:26.981118 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:26.981118 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:26.981587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] PATH_INFO: `/v3/projects/43712cd95c95454fa36cab3a47508191` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:26.983519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43712cd95c95454fa36cab3a47508191)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:26.985895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:27.067801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 919/1856] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:26 2022] DELETE /identity/v3/users/dda8131fa2344ed0a6db5d7f209803f6 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:27.134540 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43712cd95c95454fa36cab3a47508191', 'request_id': 'req-0469e087-bbd9-4dbb-86aa-2ae580441892'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:27.235944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43712cd95c95454fa36cab3a47508191', 'request_id': 'req-0469e087-bbd9-4dbb-86aa-2ae580441892'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:27.243387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43712cd95c95454fa36cab3a47508191', 'request_id': 'req-0469e087-bbd9-4dbb-86aa-2ae580441892'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:27.254086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] The token cache is being invalidate because project 43712cd95c95454fa36cab3a47508191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:27.254382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:27.255169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:27.256860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 938/1857] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:26 2022] DELETE /identity/v3/projects/43712cd95c95454fa36cab3a47508191 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:27.263993 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e3b6-9fbe-4b41-a780-a829067213db None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:27.264321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e3b6-9fbe-4b41-a780-a829067213db None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:27.267059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e3b6-9fbe-4b41-a780-a829067213db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:27.294443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-87f6e3b6-9fbe-4b41-a780-a829067213db None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:27.294443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-87f6e3b6-9fbe-4b41-a780-a829067213db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:27.364774 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:27.366411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:27.383571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469e087-bbd9-4dbb-86aa-2ae580441892 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:27.390132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:27.391167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:27.391459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:27.391739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] PATH_INFO: `/v3/projects/8678367bd0214c508311a75bf6eab669` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:27.392987 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8678367bd0214c508311a75bf6eab669)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:27.395389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:27.398061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 920/1858] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:27.406452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863e5c3-fd7d-42e9-ab86-29b06000369a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:27.407064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863e5c3-fd7d-42e9-ab86-29b06000369a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:27.409113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863e5c3-fd7d-42e9-ab86-29b06000369a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:27.443170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3863e5c3-fd7d-42e9-ab86-29b06000369a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:27.444408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3863e5c3-fd7d-42e9-ab86-29b06000369a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:27.470084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 921/1859] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:27.471112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863e5c3-fd7d-42e9-ab86-29b06000369a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:27.482134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863e5c3-fd7d-42e9-ab86-29b06000369a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:27.488059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911657b-d777-4cd0-9a31-aa98214943ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:27.488739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911657b-d777-4cd0-9a31-aa98214943ad admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:27.489074 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911657b-d777-4cd0-9a31-aa98214943ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:27.489351 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911657b-d777-4cd0-9a31-aa98214943ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:27.490781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911657b-d777-4cd0-9a31-aa98214943ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:27.491142 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911657b-d777-4cd0-9a31-aa98214943ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:27.492769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911657b-d777-4cd0-9a31-aa98214943ad admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:27.507363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 922/1860] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:27.512046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911657b-d777-4cd0-9a31-aa98214943ad admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:27.523901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911657b-d777-4cd0-9a31-aa98214943ad admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:27.529353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f18ab-64c2-4da2-9452-ea4197fade4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:27.530141 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f18ab-64c2-4da2-9452-ea4197fade4b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:27.530550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f18ab-64c2-4da2-9452-ea4197fade4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:27.530924 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f18ab-64c2-4da2-9452-ea4197fade4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:27.531838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f18ab-64c2-4da2-9452-ea4197fade4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:27.534439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f18ab-64c2-4da2-9452-ea4197fade4b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:27.571108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8678367bd0214c508311a75bf6eab669', 'request_id': 'req-1cca433f-5371-4754-8358-6a73787ea5c0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:27.742001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 923/1861] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:27 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:27.742792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f18ab-64c2-4da2-9452-ea4197fade4b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:27.750465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0b6f18ab-64c2-4da2-9452-ea4197fade4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:27.763953 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8678367bd0214c508311a75bf6eab669', 'request_id': 'req-1cca433f-5371-4754-8358-6a73787ea5c0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:27.772680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8678367bd0214c508311a75bf6eab669', 'request_id': 'req-1cca433f-5371-4754-8358-6a73787ea5c0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:27.790106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] The token cache is being invalidate because project 8678367bd0214c508311a75bf6eab669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:27.790622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:27.791796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:27.793312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 939/1862] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:27 2022] DELETE /identity/v3/projects/8678367bd0214c508311a75bf6eab669 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:27.794514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:27.795903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:27.874231 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f18ab-64c2-4da2-9452-ea4197fade4b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:27.880054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:27.881052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:27.881340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:27.881618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] PATH_INFO: `/v3/projects/4f6b7aeb9d2a4f7ba510050d0742b134` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:27.887979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6b7aeb9d2a4f7ba510050d0742b134)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:27.887979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:27.890373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca433f-5371-4754-8358-6a73787ea5c0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:27.897162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f1ad-4f01-4f26-8392-be0a32339871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:27.897873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f1ad-4f01-4f26-8392-be0a32339871 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:27.898318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f1ad-4f01-4f26-8392-be0a32339871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:27.898671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f1ad-4f01-4f26-8392-be0a32339871 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:27.900189 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5f1ad-4f01-4f26-8392-be0a32339871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:27.902254 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5f1ad-4f01-4f26-8392-be0a32339871 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:28.004788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 940/1863] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:27 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:28.007065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f1ad-4f01-4f26-8392-be0a32339871 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:28.011203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1ac5f1ad-4f01-4f26-8392-be0a32339871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:28.029168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6b7aeb9d2a4f7ba510050d0742b134', 'request_id': 'req-dbdb650d-7a50-4037-a898-f90c834cb113'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:28.044296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f1ad-4f01-4f26-8392-be0a32339871 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:28.116765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6b7aeb9d2a4f7ba510050d0742b134', 'request_id': 'req-dbdb650d-7a50-4037-a898-f90c834cb113'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:28.123092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:28.124297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:28.124720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:28.125166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] PATH_INFO: `/v3/users/1517023ded0b473484d0198f9d19b96d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:28.126445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6b7aeb9d2a4f7ba510050d0742b134', 'request_id': 'req-dbdb650d-7a50-4037-a898-f90c834cb113'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:28.127650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1517023ded0b473484d0198f9d19b96d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:28.129948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:28.148584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] The token cache is being invalidate because project 4f6b7aeb9d2a4f7ba510050d0742b134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:28.149121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:28.149938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:28.152584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 924/1864] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:27 2022] DELETE /identity/v3/projects/4f6b7aeb9d2a4f7ba510050d0742b134 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:28.157247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:28.158801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:28.188015 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb650d-7a50-4037-a898-f90c834cb113 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:28.194540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571b59f-a206-45d0-a74f-da3070ff935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:28.195651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571b59f-a206-45d0-a74f-da3070ff935d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:28.196083 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571b59f-a206-45d0-a74f-da3070ff935d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:28.196705 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571b59f-a206-45d0-a74f-da3070ff935d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:28.197661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571b59f-a206-45d0-a74f-da3070ff935d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:28.199630 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571b59f-a206-45d0-a74f-da3070ff935d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:28.212558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 925/1865] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:28.213873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b46b-978f-451c-8c35-75241cd9cdcc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:28.216717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b46b-978f-451c-8c35-75241cd9cdcc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:28.216717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727b46b-978f-451c-8c35-75241cd9cdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:28.253008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a727b46b-978f-451c-8c35-75241cd9cdcc None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:28.254806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a727b46b-978f-451c-8c35-75241cd9cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:28.286064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 926/1866] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:28.288259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727b46b-978f-451c-8c35-75241cd9cdcc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:28.307983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727b46b-978f-451c-8c35-75241cd9cdcc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:28.317044 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2ed2a-6512-4ff4-8adc-0ab85fffe77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:28.317892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2ed2a-6512-4ff4-8adc-0ab85fffe77f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:28.318236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2ed2a-6512-4ff4-8adc-0ab85fffe77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:28.318575 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2ed2a-6512-4ff4-8adc-0ab85fffe77f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:28.319439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2ed2a-6512-4ff4-8adc-0ab85fffe77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:28.322187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2ed2a-6512-4ff4-8adc-0ab85fffe77f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:28.334807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 927/1867] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:28.339902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda7288-2fa8-4110-bf10-73ea7e52e089 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:28.340248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda7288-2fa8-4110-bf10-73ea7e52e089 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:28.341093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda7288-2fa8-4110-bf10-73ea7e52e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:28.373350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1517023ded0b473484d0198f9d19b96d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:28.378617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8fda7288-2fa8-4110-bf10-73ea7e52e089 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:28.380872 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8fda7288-2fa8-4110-bf10-73ea7e52e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:28.390019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1517023ded0b473484d0198f9d19b96d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:28.405250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 928/1868] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:28.406280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda7288-2fa8-4110-bf10-73ea7e52e089 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:28.439131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda7288-2fa8-4110-bf10-73ea7e52e089 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:28.444660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27209bb5-fded-4b16-9a37-b0f4fba9eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:28.447281 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209bb5-fded-4b16-9a37-b0f4fba9eafa admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:28.453284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209bb5-fded-4b16-9a37-b0f4fba9eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:28.453284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209bb5-fded-4b16-9a37-b0f4fba9eafa admin admin] PATH_INFO: `/v3/projects/f2012c091248449fb181bd07e1b29117/users/57470a1a1b11463c8bb7fc1f9c017235/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:28.473597 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27209bb5-fded-4b16-9a37-b0f4fba9eafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2012c091248449fb181bd07e1b29117, user_id=57470a1a1b11463c8bb7fc1f9c017235, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:28.482521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27209bb5-fded-4b16-9a37-b0f4fba9eafa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:28.510481 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1517023ded0b473484d0198f9d19b96d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:28.519964 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1517023ded0b473484d0198f9d19b96d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:28.521420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1517023ded0b473484d0198f9d19b96d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:28.531649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 941/1869] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:28 2022] DELETE /identity/v3/users/1517023ded0b473484d0198f9d19b96d => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:28.532932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:28.535497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:28.601611 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 929/1870] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:28 2022] PUT /identity/v3/projects/f2012c091248449fb181bd07e1b29117/users/57470a1a1b11463c8bb7fc1f9c017235/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:28.613541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ab27-978d-42d6-871a-b798d4b3e7cc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:28.614053 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ab27-978d-42d6-871a-b798d4b3e7cc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:28.614353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ab27-978d-42d6-871a-b798d4b3e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:28.657744 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f93d-f5c2-47d3-bee0-60263c5fcc82 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:28.661043 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d234ab27-978d-42d6-871a-b798d4b3e7cc None None] MFA Rules not processed for user `57470a1a1b11463c8bb7fc1f9c017235`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:28.663498 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d234ab27-978d-42d6-871a-b798d4b3e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:28.757414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3e2d6-be19-41e6-b7d5-0ef3faa563c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:28.759586 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3e2d6-be19-41e6-b7d5-0ef3faa563c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:28.760063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3e2d6-be19-41e6-b7d5-0ef3faa563c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:28.760419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3e2d6-be19-41e6-b7d5-0ef3faa563c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:28.761283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3e2d6-be19-41e6-b7d5-0ef3faa563c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:28.761685 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3e2d6-be19-41e6-b7d5-0ef3faa563c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:28.764263 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3e2d6-be19-41e6-b7d5-0ef3faa563c6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:28.793374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 930/1871] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:28.795013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 942/1872] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:28.795207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234ab27-978d-42d6-871a-b798d4b3e7cc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:28.799190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3e2d6-be19-41e6-b7d5-0ef3faa563c6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:28.801391 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5ab3e2d6-be19-41e6-b7d5-0ef3faa563c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:28.809300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234ab27-978d-42d6-871a-b798d4b3e7cc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:28.815211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3e2d6-be19-41e6-b7d5-0ef3faa563c6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:28.815424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3499-f183-4e4f-9cea-082720795593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:28.816091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3499-f183-4e4f-9cea-082720795593 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:28.816378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3499-f183-4e4f-9cea-082720795593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:28.816732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3499-f183-4e4f-9cea-082720795593 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:28.817769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f3499-f183-4e4f-9cea-082720795593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:28.819337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f3499-f183-4e4f-9cea-082720795593 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:28.820912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b8a0b-ae4d-4b8a-a06b-5a743f85e7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:28.821642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b8a0b-ae4d-4b8a-a06b-5a743f85e7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:28.821929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b8a0b-ae4d-4b8a-a06b-5a743f85e7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:28.822213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b8a0b-ae4d-4b8a-a06b-5a743f85e7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:28.822916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b8a0b-ae4d-4b8a-a06b-5a743f85e7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:28.825616 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b8a0b-ae4d-4b8a-a06b-5a743f85e7a5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:28.960013 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 931/1873] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:28 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:28.964296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3499-f183-4e4f-9cea-082720795593 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:28.968050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 943/1874] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:28 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:28.969360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b8a0b-ae4d-4b8a-a06b-5a743f85e7a5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:29.069734 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3499-f183-4e4f-9cea-082720795593 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:29.074308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b8a0b-ae4d-4b8a-a06b-5a743f85e7a5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:29.076502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff4b5f-3dff-4734-bc7c-d81922cd34a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:29.077495 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff4b5f-3dff-4734-bc7c-d81922cd34a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.077865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff4b5f-3dff-4734-bc7c-d81922cd34a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.078272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff4b5f-3dff-4734-bc7c-d81922cd34a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.079042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff4b5f-3dff-4734-bc7c-d81922cd34a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:29.081429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff4b5f-3dff-4734-bc7c-d81922cd34a1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:29.090642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be560de8-3411-4748-915c-d5fd2a79ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:29.091616 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560de8-3411-4748-915c-d5fd2a79ed49 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.091901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560de8-3411-4748-915c-d5fd2a79ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.092184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560de8-3411-4748-915c-d5fd2a79ed49 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.092888 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be560de8-3411-4748-915c-d5fd2a79ed49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:29.094913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be560de8-3411-4748-915c-d5fd2a79ed49 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:29.198216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 932/1875] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:28 2022] POST /identity/v3/users => generated 284 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:29.204418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff4b5f-3dff-4734-bc7c-d81922cd34a1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:29.217301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff4b5f-3dff-4734-bc7c-d81922cd34a1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:29.227183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606af77-e243-4e84-b6cb-682ebb6b34f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:29.227624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 944/1876] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:28 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:29.228297 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606af77-e243-4e84-b6cb-682ebb6b34f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.228726 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606af77-e243-4e84-b6cb-682ebb6b34f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.229261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606af77-e243-4e84-b6cb-682ebb6b34f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.230405 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606af77-e243-4e84-b6cb-682ebb6b34f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:29.232059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606af77-e243-4e84-b6cb-682ebb6b34f5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:29.234159 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be560de8-3411-4748-915c-d5fd2a79ed49 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:29.244900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 933/1877] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:26:29.248801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606af77-e243-4e84-b6cb-682ebb6b34f5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:29.254859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be560de8-3411-4748-915c-d5fd2a79ed49 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:29.272443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc5c31-1a8b-4982-ab4c-8fa242cf76e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:29.272572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606af77-e243-4e84-b6cb-682ebb6b34f5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:29.274554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc5c31-1a8b-4982-ab4c-8fa242cf76e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.275285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc5c31-1a8b-4982-ab4c-8fa242cf76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.276158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc5c31-1a8b-4982-ab4c-8fa242cf76e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.280160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc5c31-1a8b-4982-ab4c-8fa242cf76e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:29.282416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc5c31-1a8b-4982-ab4c-8fa242cf76e5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:29.287159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8e759-40e5-4d13-9b6e-e55b35fa9b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:29.291909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8e759-40e5-4d13-9b6e-e55b35fa9b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.291909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8e759-40e5-4d13-9b6e-e55b35fa9b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.291909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8e759-40e5-4d13-9b6e-e55b35fa9b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.291909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8e759-40e5-4d13-9b6e-e55b35fa9b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:29.291909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8e759-40e5-4d13-9b6e-e55b35fa9b78 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:29.308728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 945/1878] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:29.312611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc5c31-1a8b-4982-ab4c-8fa242cf76e5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:29.316844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 934/1879] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:29.320082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-98bc5c31-1a8b-4982-ab4c-8fa242cf76e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:29.320561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8e759-40e5-4d13-9b6e-e55b35fa9b78 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:29.336210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc5c31-1a8b-4982-ab4c-8fa242cf76e5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:29.342353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8e759-40e5-4d13-9b6e-e55b35fa9b78 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:29.351245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eeb855-62df-4086-8dbb-282f575f18ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:29.352051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeb855-62df-4086-8dbb-282f575f18ae admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.352525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeb855-62df-4086-8dbb-282f575f18ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.353038 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeb855-62df-4086-8dbb-282f575f18ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.353263 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:29.353907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eeb855-62df-4086-8dbb-282f575f18ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:29.354150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.354626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.354916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] PATH_INFO: `/v3/projects/41547bc5007a407abadf44872469ffdc` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.356422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eeb855-62df-4086-8dbb-282f575f18ae admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:29.357211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41547bc5007a407abadf44872469ffdc)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:29.359097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:29.371247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 935/1880] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:29.371247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eeb855-62df-4086-8dbb-282f575f18ae admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:29.381096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eeb855-62df-4086-8dbb-282f575f18ae admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:29.396261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cef3d0-68d4-4e58-a318-4abd87b1a359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:29.397670 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef3d0-68d4-4e58-a318-4abd87b1a359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.399972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef3d0-68d4-4e58-a318-4abd87b1a359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.399972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef3d0-68d4-4e58-a318-4abd87b1a359 admin admin] PATH_INFO: `/v3/projects/cc8e46d0a2374dca9c69fcdcb5b4ceab/users/e3d8bba8b5ef415ca8cdeb89d0114392/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.429466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cef3d0-68d4-4e58-a318-4abd87b1a359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8e46d0a2374dca9c69fcdcb5b4ceab, user_id=e3d8bba8b5ef415ca8cdeb89d0114392, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:29.429466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cef3d0-68d4-4e58-a318-4abd87b1a359 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:29.530404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 936/1881] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:29 2022] PUT /identity/v3/projects/cc8e46d0a2374dca9c69fcdcb5b4ceab/users/e3d8bba8b5ef415ca8cdeb89d0114392/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:29.531434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cef3d0-68d4-4e58-a318-4abd87b1a359 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:29.541569 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41547bc5007a407abadf44872469ffdc', 'request_id': 'req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:29.608531 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cef3d0-68d4-4e58-a318-4abd87b1a359 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:29.644440 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41547bc5007a407abadf44872469ffdc', 'request_id': 'req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:29.657152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41547bc5007a407abadf44872469ffdc', 'request_id': 'req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:29.684243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] The token cache is being invalidate because project 41547bc5007a407abadf44872469ffdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:29.685086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:29.685547 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36752c-4389-438d-bcc2-6c4cfaf811d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:29.685811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c1505eb4-ff8c-4c70-8c01-9c5657833ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:29.686719 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36752c-4389-438d-bcc2-6c4cfaf811d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.687061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36752c-4389-438d-bcc2-6c4cfaf811d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.687400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36752c-4389-438d-bcc2-6c4cfaf811d2 admin admin] PATH_INFO: `/v3/projects/55376bb1b07f465491df72d4998544a3/users/1754c40b27c143c9a7d2a341d7e3b1f9/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.692179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 946/1882] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:29 2022] DELETE /identity/v3/projects/41547bc5007a407abadf44872469ffdc => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:29.692179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8f53-ce9a-4773-906d-95a02d8c1e92 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.692179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8f53-ce9a-4773-906d-95a02d8c1e92 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.692179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8f53-ce9a-4773-906d-95a02d8c1e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.703972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36752c-4389-438d-bcc2-6c4cfaf811d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55376bb1b07f465491df72d4998544a3, user_id=1754c40b27c143c9a7d2a341d7e3b1f9, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:29.706796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36752c-4389-438d-bcc2-6c4cfaf811d2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:29.722686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5e2b8f53-ce9a-4773-906d-95a02d8c1e92 None None] MFA Rules not processed for user `e3d8bba8b5ef415ca8cdeb89d0114392`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:29.724180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5e2b8f53-ce9a-4773-906d-95a02d8c1e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:29.798805 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 947/1883] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:29.799771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b8f53-ce9a-4773-906d-95a02d8c1e92 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:29.801515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5e2b8f53-ce9a-4773-906d-95a02d8c1e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:29.818963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b8f53-ce9a-4773-906d-95a02d8c1e92 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:29.827656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 937/1884] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:29 2022] PUT /identity/v3/projects/55376bb1b07f465491df72d4998544a3/users/1754c40b27c143c9a7d2a341d7e3b1f9/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:29.828811 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36752c-4389-438d-bcc2-6c4cfaf811d2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:29.830704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cb36752c-4389-438d-bcc2-6c4cfaf811d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:29.904254 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:29.906294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.906691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.907279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] PATH_INFO: `/v3/users/1504d8114b884dff8601b7318c21dc9a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.912204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1504d8114b884dff8601b7318c21dc9a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:29.914881 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:29.924436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36752c-4389-438d-bcc2-6c4cfaf811d2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:29.933529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93e076-70f3-4e86-8796-aed3713cb1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:29.935416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93e076-70f3-4e86-8796-aed3713cb1ad admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:29.936089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93e076-70f3-4e86-8796-aed3713cb1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:29.936377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93e076-70f3-4e86-8796-aed3713cb1ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:29.938006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93e076-70f3-4e86-8796-aed3713cb1ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:29.942170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93e076-70f3-4e86-8796-aed3713cb1ad admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:30.066864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 938/1885] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:29 2022] POST /identity/v3/projects => generated 369 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:30.068307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed835e-997b-429a-bab8-e923d2a2dd0f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:30.068601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed835e-997b-429a-bab8-e923d2a2dd0f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:30.068879 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed835e-997b-429a-bab8-e923d2a2dd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:30.098885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-82ed835e-997b-429a-bab8-e923d2a2dd0f None None] MFA Rules not processed for user `1754c40b27c143c9a7d2a341d7e3b1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:30.100125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-82ed835e-997b-429a-bab8-e923d2a2dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:30.197381 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1504d8114b884dff8601b7318c21dc9a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:30.205765 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1504d8114b884dff8601b7318c21dc9a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:30.216208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 939/1886] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:30.217192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed835e-997b-429a-bab8-e923d2a2dd0f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:30.299147 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1504d8114b884dff8601b7318c21dc9a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:30.314634 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1504d8114b884dff8601b7318c21dc9a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:30.316119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1504d8114b884dff8601b7318c21dc9a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:30.334224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 948/1887] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:29 2022] DELETE /identity/v3/users/1504d8114b884dff8601b7318c21dc9a => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:30.342123 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:30.343609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:30.352612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed835e-997b-429a-bab8-e923d2a2dd0f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:30.437338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba51f-49a6-44ab-b295-5e1444dcf673 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:30.443849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45635-65fa-45a3-90c0-3f905d38ebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:30.445236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45635-65fa-45a3-90c0-3f905d38ebe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:30.445942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45635-65fa-45a3-90c0-3f905d38ebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:30.446225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45635-65fa-45a3-90c0-3f905d38ebe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:30.447049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a45635-65fa-45a3-90c0-3f905d38ebe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:30.449227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a45635-65fa-45a3-90c0-3f905d38ebe2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:30.452274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054f3a9-f31f-4d8c-b7e1-57ba5d389d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:30.453247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054f3a9-f31f-4d8c-b7e1-57ba5d389d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:30.453864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054f3a9-f31f-4d8c-b7e1-57ba5d389d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:30.461614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054f3a9-f31f-4d8c-b7e1-57ba5d389d78 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:30.461614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054f3a9-f31f-4d8c-b7e1-57ba5d389d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:30.461614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054f3a9-f31f-4d8c-b7e1-57ba5d389d78 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:30.589634 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 949/1888] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:30 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:30.592076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 940/1889] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:30 2022] POST /identity/v3/users => generated 291 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:30.595992 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45635-65fa-45a3-90c0-3f905d38ebe2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:30.599312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054f3a9-f31f-4d8c-b7e1-57ba5d389d78 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:30.602745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5054f3a9-f31f-4d8c-b7e1-57ba5d389d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:30.644440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054f3a9-f31f-4d8c-b7e1-57ba5d389d78 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:30.728633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45635-65fa-45a3-90c0-3f905d38ebe2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:30.754324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc37f2e-b3b4-4aef-a5d2-3c48c466a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:30.754940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc37f2e-b3b4-4aef-a5d2-3c48c466a890 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:30.755274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc37f2e-b3b4-4aef-a5d2-3c48c466a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:30.755492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc37f2e-b3b4-4aef-a5d2-3c48c466a890 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:30.756239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc37f2e-b3b4-4aef-a5d2-3c48c466a890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:30.758234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc37f2e-b3b4-4aef-a5d2-3c48c466a890 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:30.769554 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e4f44-21e2-4c33-aa1e-4eea3b6f3b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:30.770345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e4f44-21e2-4c33-aa1e-4eea3b6f3b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:30.777183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e4f44-21e2-4c33-aa1e-4eea3b6f3b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:30.777183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e4f44-21e2-4c33-aa1e-4eea3b6f3b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:30.777183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e4f44-21e2-4c33-aa1e-4eea3b6f3b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:30.777183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e4f44-21e2-4c33-aa1e-4eea3b6f3b0b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:30.800893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 941/1890] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:30.811022 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e4f44-21e2-4c33-aa1e-4eea3b6f3b0b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:30.833495 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e4f44-21e2-4c33-aa1e-4eea3b6f3b0b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:30.838991 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd73b28-7c11-4d7a-9b71-af3ff6aa419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:30.839979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73b28-7c11-4d7a-9b71-af3ff6aa419f admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:30.841550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73b28-7c11-4d7a-9b71-af3ff6aa419f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:30.841905 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73b28-7c11-4d7a-9b71-af3ff6aa419f admin admin] PATH_INFO: `/v3/projects/b29c205cefbc425fbaa036fd0f519445/users/3a0593bfdfde4785b27ca03b90d824c2/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:30.865809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd73b28-7c11-4d7a-9b71-af3ff6aa419f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29c205cefbc425fbaa036fd0f519445, user_id=3a0593bfdfde4785b27ca03b90d824c2, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:30.868902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd73b28-7c11-4d7a-9b71-af3ff6aa419f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:30.923022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 950/1891] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:30 2022] POST /identity/v3/users => generated 299 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:30.924816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc37f2e-b3b4-4aef-a5d2-3c48c466a890 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:30.939090 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc37f2e-b3b4-4aef-a5d2-3c48c466a890 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:30.952209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a796a38-337c-401e-ae30-4d2e0ed2218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:30.953320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a796a38-337c-401e-ae30-4d2e0ed2218e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:30.953681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a796a38-337c-401e-ae30-4d2e0ed2218e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:30.954049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a796a38-337c-401e-ae30-4d2e0ed2218e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:30.954879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a796a38-337c-401e-ae30-4d2e0ed2218e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:30.956802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a796a38-337c-401e-ae30-4d2e0ed2218e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:30.975232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 951/1892] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:30.976304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a796a38-337c-401e-ae30-4d2e0ed2218e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:30.990286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 942/1893] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:30 2022] PUT /identity/v3/projects/b29c205cefbc425fbaa036fd0f519445/users/3a0593bfdfde4785b27ca03b90d824c2/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:30.994749 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a796a38-337c-401e-ae30-4d2e0ed2218e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:30.998622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd73b28-7c11-4d7a-9b71-af3ff6aa419f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:31.089657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd73b28-7c11-4d7a-9b71-af3ff6aa419f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:31.095835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868a17-71f9-49e1-8955-ba1088067ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:31.096564 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868a17-71f9-49e1-8955-ba1088067ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.096856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868a17-71f9-49e1-8955-ba1088067ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.097179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868a17-71f9-49e1-8955-ba1088067ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.097885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868a17-71f9-49e1-8955-ba1088067ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:31.122217 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868a17-71f9-49e1-8955-ba1088067ccb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:31.151668 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 943/1894] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:31.153587 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868a17-71f9-49e1-8955-ba1088067ccb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:31.160384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52667621-16d7-4f02-b717-1fabab072f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:31.162976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52667621-16d7-4f02-b717-1fabab072f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.163301 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52667621-16d7-4f02-b717-1fabab072f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.163592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52667621-16d7-4f02-b717-1fabab072f20 admin admin] PATH_INFO: `/v3/projects/24b9430f62fc43da89b2421ce943894c/users/2b6c5402b514450abfeab0485ed1c7cc/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.164649 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868a17-71f9-49e1-8955-ba1088067ccb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:31.170336 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347f128-454e-4eae-a1e8-5653995a1337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:31.171389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347f128-454e-4eae-a1e8-5653995a1337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.171788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347f128-454e-4eae-a1e8-5653995a1337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.172171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347f128-454e-4eae-a1e8-5653995a1337 admin admin] PATH_INFO: `/v3/projects/b29c205cefbc425fbaa036fd0f519445/users/3a0593bfdfde4785b27ca03b90d824c2/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.174788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347f128-454e-4eae-a1e8-5653995a1337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29c205cefbc425fbaa036fd0f519445, user_id=3a0593bfdfde4785b27ca03b90d824c2, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:31.177659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347f128-454e-4eae-a1e8-5653995a1337 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:31.197420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 944/1895] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:31 2022] PUT /identity/v3/projects/b29c205cefbc425fbaa036fd0f519445/users/3a0593bfdfde4785b27ca03b90d824c2/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:31.200268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52667621-16d7-4f02-b717-1fabab072f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b9430f62fc43da89b2421ce943894c, user_id=2b6c5402b514450abfeab0485ed1c7cc, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:31.203136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d5622-fd9b-4dbd-8576-f1ef69948fc5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.203596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d5622-fd9b-4dbd-8576-f1ef69948fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.203993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52667621-16d7-4f02-b717-1fabab072f20 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:31.204122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d5622-fd9b-4dbd-8576-f1ef69948fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.239567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c50d5622-fd9b-4dbd-8576-f1ef69948fc5 None None] MFA Rules not processed for user `3a0593bfdfde4785b27ca03b90d824c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:31.240780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c50d5622-fd9b-4dbd-8576-f1ef69948fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:31.280830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 952/1896] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:30 2022] PUT /identity/v3/projects/24b9430f62fc43da89b2421ce943894c/users/2b6c5402b514450abfeab0485ed1c7cc/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:31.282106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52667621-16d7-4f02-b717-1fabab072f20 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:31.350384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 945/1897] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:31.368920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d5622-fd9b-4dbd-8576-f1ef69948fc5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:31.370526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c50d5622-fd9b-4dbd-8576-f1ef69948fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:31.392087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52667621-16d7-4f02-b717-1fabab072f20 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:31.400480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7988e56-cd32-467c-9e31-8bf5996d13e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:31.401344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7988e56-cd32-467c-9e31-8bf5996d13e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.401732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7988e56-cd32-467c-9e31-8bf5996d13e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.402112 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7988e56-cd32-467c-9e31-8bf5996d13e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.405275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7988e56-cd32-467c-9e31-8bf5996d13e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:31.407577 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7988e56-cd32-467c-9e31-8bf5996d13e8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:31.430811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 953/1898] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:31.430811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7988e56-cd32-467c-9e31-8bf5996d13e8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:31.430811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a7988e56-cd32-467c-9e31-8bf5996d13e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:31.444915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7988e56-cd32-467c-9e31-8bf5996d13e8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:31.451627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:31.452498 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.452782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.457974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] PATH_INFO: `/v3/projects/159a75349ea642ad82ce691432966d95` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.457974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=159a75349ea642ad82ce691432966d95)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:31.457974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:31.467502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d5622-fd9b-4dbd-8576-f1ef69948fc5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:31.522901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cdd84-e1ad-4d5f-9650-9d3be35fc2a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:31.523462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cdd84-e1ad-4d5f-9650-9d3be35fc2a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.523746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cdd84-e1ad-4d5f-9650-9d3be35fc2a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.524025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cdd84-e1ad-4d5f-9650-9d3be35fc2a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.587294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159a75349ea642ad82ce691432966d95', 'request_id': 'req-8938ca7c-3210-4694-9110-cfe666c86ec8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:31.587559 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cdd84-e1ad-4d5f-9650-9d3be35fc2a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:31.589183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cdd84-e1ad-4d5f-9650-9d3be35fc2a9 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:31.604462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 946/1899] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:26:31.605301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cdd84-e1ad-4d5f-9650-9d3be35fc2a9 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:31.616018 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cdd84-e1ad-4d5f-9650-9d3be35fc2a9 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:31.686406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60a47e-e2a9-4df8-944a-5fbfcb26639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:31.687332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60a47e-e2a9-4df8-944a-5fbfcb26639d admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.691698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60a47e-e2a9-4df8-944a-5fbfcb26639d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.691698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60a47e-e2a9-4df8-944a-5fbfcb26639d admin admin] PATH_INFO: `/v3/projects/24b9430f62fc43da89b2421ce943894c/users/2b6c5402b514450abfeab0485ed1c7cc/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.691698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60a47e-e2a9-4df8-944a-5fbfcb26639d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b9430f62fc43da89b2421ce943894c, user_id=2b6c5402b514450abfeab0485ed1c7cc, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:31.692947 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60a47e-e2a9-4df8-944a-5fbfcb26639d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:31.703473 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 947/1900] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:31 2022] PUT /identity/v3/projects/24b9430f62fc43da89b2421ce943894c/users/2b6c5402b514450abfeab0485ed1c7cc/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:31.711539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159a75349ea642ad82ce691432966d95', 'request_id': 'req-8938ca7c-3210-4694-9110-cfe666c86ec8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:31.713832 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd3490-3987-4f82-a9c3-03abf9b586bf None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.714303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd3490-3987-4f82-a9c3-03abf9b586bf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.714592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd3490-3987-4f82-a9c3-03abf9b586bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.719884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159a75349ea642ad82ce691432966d95', 'request_id': 'req-8938ca7c-3210-4694-9110-cfe666c86ec8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:31.735426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] The token cache is being invalidate because project 159a75349ea642ad82ce691432966d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:31.735752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:31.736383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8938ca7c-3210-4694-9110-cfe666c86ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:31.738006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 954/1901] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:31 2022] DELETE /identity/v3/projects/159a75349ea642ad82ce691432966d95 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:31.743998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708b47-3e44-471d-9a38-8cc33a8e0021 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.744345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708b47-3e44-471d-9a38-8cc33a8e0021 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.744626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708b47-3e44-471d-9a38-8cc33a8e0021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.745835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-01fd3490-3987-4f82-a9c3-03abf9b586bf None None] MFA Rules not processed for user `2b6c5402b514450abfeab0485ed1c7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:31.747718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-01fd3490-3987-4f82-a9c3-03abf9b586bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:31.764070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a1708b47-3e44-471d-9a38-8cc33a8e0021 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:31.765333 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a1708b47-3e44-471d-9a38-8cc33a8e0021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:31.839296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 948/1902] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:31.839296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd3490-3987-4f82-a9c3-03abf9b586bf None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:31.840939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-01fd3490-3987-4f82-a9c3-03abf9b586bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:31.843283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 955/1903] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:31.848018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1708b47-3e44-471d-9a38-8cc33a8e0021 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:31.850280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a1708b47-3e44-471d-9a38-8cc33a8e0021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:31.914183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd3490-3987-4f82-a9c3-03abf9b586bf None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:31.920140 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aec4d-017a-420f-a169-6216c244a91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:31.920838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aec4d-017a-420f-a169-6216c244a91e service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.921125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aec4d-017a-420f-a169-6216c244a91e service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.921544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aec4d-017a-420f-a169-6216c244a91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.924038 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4d9aec4d-017a-420f-a169-6216c244a91e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:31.932062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1708b47-3e44-471d-9a38-8cc33a8e0021 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:31.938871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317fe97-e557-478e-b65d-cdde50c57217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:31.939850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317fe97-e557-478e-b65d-cdde50c57217 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:31.940403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317fe97-e557-478e-b65d-cdde50c57217 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:31.940789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317fe97-e557-478e-b65d-cdde50c57217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:31.942820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5317fe97-e557-478e-b65d-cdde50c57217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:32.010554 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aec4d-017a-420f-a169-6216c244a91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:32.013122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aec4d-017a-420f-a169-6216c244a91e service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:32.016556 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317fe97-e557-478e-b65d-cdde50c57217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:32.018850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317fe97-e557-478e-b65d-cdde50c57217 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:32.022951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 949/1904] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:32.031432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 956/1905] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:26:32.034496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9316a-d3a5-4446-b46c-36597ae6db99 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:32.034977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9316a-d3a5-4446-b46c-36597ae6db99 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:32.035336 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9316a-d3a5-4446-b46c-36597ae6db99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:32.056365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-54b9316a-d3a5-4446-b46c-36597ae6db99 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:32.057689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-54b9316a-d3a5-4446-b46c-36597ae6db99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:32.075922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 950/1906] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:32.077764 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317fe97-e557-478e-b65d-cdde50c57217 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:32.094728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317fe97-e557-478e-b65d-cdde50c57217 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:32.101006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5510-e3b1-47a9-b30b-480bc814732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:32.101670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5510-e3b1-47a9-b30b-480bc814732f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:32.101957 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5510-e3b1-47a9-b30b-480bc814732f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:32.102394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5510-e3b1-47a9-b30b-480bc814732f admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:32.103215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc5510-e3b1-47a9-b30b-480bc814732f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:32.103763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc5510-e3b1-47a9-b30b-480bc814732f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:32.106181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc5510-e3b1-47a9-b30b-480bc814732f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:32.123228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 957/1907] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:32.127663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9316a-d3a5-4446-b46c-36597ae6db99 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:32.138244 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9316a-d3a5-4446-b46c-36597ae6db99 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:32.143245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e246ab-5772-46de-a5ce-333d0782cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:32.143922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e246ab-5772-46de-a5ce-333d0782cc40 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:32.144211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e246ab-5772-46de-a5ce-333d0782cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:32.144545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e246ab-5772-46de-a5ce-333d0782cc40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:32.145442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e246ab-5772-46de-a5ce-333d0782cc40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:32.147694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e246ab-5772-46de-a5ce-333d0782cc40 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:32.241777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 951/1908] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:32 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:32.246337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5510-e3b1-47a9-b30b-480bc814732f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:32.256864 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5510-e3b1-47a9-b30b-480bc814732f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:32.316053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c478b29-07f5-4f7f-8f2a-72d74d427c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:32.316645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478b29-07f5-4f7f-8f2a-72d74d427c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:32.316927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478b29-07f5-4f7f-8f2a-72d74d427c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:32.317260 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478b29-07f5-4f7f-8f2a-72d74d427c9c admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:32.317979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c478b29-07f5-4f7f-8f2a-72d74d427c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:32.319887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c478b29-07f5-4f7f-8f2a-72d74d427c9c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:32.452116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 958/1909] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:32 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:32.453384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e246ab-5772-46de-a5ce-333d0782cc40 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:32.463612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e246ab-5772-46de-a5ce-333d0782cc40 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:32.468860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbf7b5-9603-4357-9868-9b2e2aba652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:32.469610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbf7b5-9603-4357-9868-9b2e2aba652a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:32.469968 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbf7b5-9603-4357-9868-9b2e2aba652a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:32.470248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbf7b5-9603-4357-9868-9b2e2aba652a admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:32.470970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbf7b5-9603-4357-9868-9b2e2aba652a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:32.472553 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbf7b5-9603-4357-9868-9b2e2aba652a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:32.483847 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 952/1910] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:32.488215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c478b29-07f5-4f7f-8f2a-72d74d427c9c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:32.499240 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c478b29-07f5-4f7f-8f2a-72d74d427c9c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:32.507380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea517726-1ab9-40a1-b0cf-16debc2a85be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:32.508086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea517726-1ab9-40a1-b0cf-16debc2a85be admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:32.515364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea517726-1ab9-40a1-b0cf-16debc2a85be admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:32.515364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea517726-1ab9-40a1-b0cf-16debc2a85be admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:32.515364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea517726-1ab9-40a1-b0cf-16debc2a85be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:32.515364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea517726-1ab9-40a1-b0cf-16debc2a85be admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:32.521755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 959/1911] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:32.526612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbf7b5-9603-4357-9868-9b2e2aba652a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:32.538290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbf7b5-9603-4357-9868-9b2e2aba652a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:32.543022 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033af120-a1b2-4768-87fd-ba701a1fbd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:32.544405 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af120-a1b2-4768-87fd-ba701a1fbd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:32.544737 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af120-a1b2-4768-87fd-ba701a1fbd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:32.545061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af120-a1b2-4768-87fd-ba701a1fbd05 admin admin] PATH_INFO: `/v3/projects/5a873402f7d8412093a8e47e962a307a/users/7035b93106a4452999c1f3aa409d4614/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:32.561298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033af120-a1b2-4768-87fd-ba701a1fbd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a873402f7d8412093a8e47e962a307a, user_id=7035b93106a4452999c1f3aa409d4614, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:32.565441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033af120-a1b2-4768-87fd-ba701a1fbd05 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:32.706902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 953/1912] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:32 2022] PUT /identity/v3/projects/5a873402f7d8412093a8e47e962a307a/users/7035b93106a4452999c1f3aa409d4614/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:32.718920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413fc6c-bc5e-4e42-884c-ca366e302bb5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:32.719402 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413fc6c-bc5e-4e42-884c-ca366e302bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:32.719819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413fc6c-bc5e-4e42-884c-ca366e302bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:32.774945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8413fc6c-bc5e-4e42-884c-ca366e302bb5 None None] MFA Rules not processed for user `7035b93106a4452999c1f3aa409d4614`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:32.774945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8413fc6c-bc5e-4e42-884c-ca366e302bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:32.877694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 960/1913] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:32.890527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033af120-a1b2-4768-87fd-ba701a1fbd05 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:32.996867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033af120-a1b2-4768-87fd-ba701a1fbd05 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:33.002170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5448879-1a3a-46ec-a85f-693ce312ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:33.002815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5448879-1a3a-46ec-a85f-693ce312ea5c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:33.003104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5448879-1a3a-46ec-a85f-693ce312ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:33.003386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5448879-1a3a-46ec-a85f-693ce312ea5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:33.004195 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5448879-1a3a-46ec-a85f-693ce312ea5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:33.006414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5448879-1a3a-46ec-a85f-693ce312ea5c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:33.092703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 954/1914] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:32 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:33.099419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413fc6c-bc5e-4e42-884c-ca366e302bb5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:33.114958 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413fc6c-bc5e-4e42-884c-ca366e302bb5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:33.184362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e005f-f63f-4a5f-8c09-3206128f26e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:33.185166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e005f-f63f-4a5f-8c09-3206128f26e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:33.185456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e005f-f63f-4a5f-8c09-3206128f26e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:33.185737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e005f-f63f-4a5f-8c09-3206128f26e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:33.186572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e005f-f63f-4a5f-8c09-3206128f26e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:33.188756 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e005f-f63f-4a5f-8c09-3206128f26e6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:33.322760 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 961/1915] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:33 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:33.330358 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5448879-1a3a-46ec-a85f-693ce312ea5c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:33.344258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5448879-1a3a-46ec-a85f-693ce312ea5c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:33.349476 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33dc50-7a2e-4ee1-bb17-82ed207de69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:33.350234 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33dc50-7a2e-4ee1-bb17-82ed207de69b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:33.350592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33dc50-7a2e-4ee1-bb17-82ed207de69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:33.350962 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33dc50-7a2e-4ee1-bb17-82ed207de69b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:33.352055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33dc50-7a2e-4ee1-bb17-82ed207de69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:33.353833 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33dc50-7a2e-4ee1-bb17-82ed207de69b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:33.369758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 955/1916] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:33.371119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e005f-f63f-4a5f-8c09-3206128f26e6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:33.381621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e005f-f63f-4a5f-8c09-3206128f26e6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:33.386815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b584476-47ab-4c5d-970e-aa7830132747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:33.388920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b584476-47ab-4c5d-970e-aa7830132747 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:33.389231 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b584476-47ab-4c5d-970e-aa7830132747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:33.389516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b584476-47ab-4c5d-970e-aa7830132747 admin admin] PATH_INFO: `/v3/projects/6d9ca1b89e8543658bbd88ac1720c294/users/e1e2b5863e804c7a9623828b6baaabe3/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:33.408093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b584476-47ab-4c5d-970e-aa7830132747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9ca1b89e8543658bbd88ac1720c294, user_id=e1e2b5863e804c7a9623828b6baaabe3, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:33.410828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b584476-47ab-4c5d-970e-aa7830132747 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:33.495826 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 962/1917] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:33 2022] PUT /identity/v3/projects/6d9ca1b89e8543658bbd88ac1720c294/users/e1e2b5863e804c7a9623828b6baaabe3/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:33.500835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33dc50-7a2e-4ee1-bb17-82ed207de69b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:33.511822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33dc50-7a2e-4ee1-bb17-82ed207de69b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:33.571297 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380751d-b033-4e3d-a258-91a3a71ea309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:33.571970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380751d-b033-4e3d-a258-91a3a71ea309 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:33.572252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380751d-b033-4e3d-a258-91a3a71ea309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:33.572559 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380751d-b033-4e3d-a258-91a3a71ea309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:33.573326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380751d-b033-4e3d-a258-91a3a71ea309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:33.575618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380751d-b033-4e3d-a258-91a3a71ea309 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:33.589440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 956/1918] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:33.591424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b584476-47ab-4c5d-970e-aa7830132747 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:33.602971 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b584476-47ab-4c5d-970e-aa7830132747 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:33.608777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be3a4-04ec-4282-ad0a-4ed45f87908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:33.609711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be3a4-04ec-4282-ad0a-4ed45f87908b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:33.609996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be3a4-04ec-4282-ad0a-4ed45f87908b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:33.610276 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be3a4-04ec-4282-ad0a-4ed45f87908b admin admin] PATH_INFO: `/v3/projects/6d9ca1b89e8543658bbd88ac1720c294/users/e1e2b5863e804c7a9623828b6baaabe3/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:33.612280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185be3a4-04ec-4282-ad0a-4ed45f87908b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9ca1b89e8543658bbd88ac1720c294, user_id=e1e2b5863e804c7a9623828b6baaabe3, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:33.615154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185be3a4-04ec-4282-ad0a-4ed45f87908b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:33.628031 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 963/1919] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:33 2022] PUT /identity/v3/projects/6d9ca1b89e8543658bbd88ac1720c294/users/e1e2b5863e804c7a9623828b6baaabe3/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:33.639777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d450e-4410-406b-8d28-9ce4e5192e62 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:33.640143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d450e-4410-406b-8d28-9ce4e5192e62 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:33.640423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d450e-4410-406b-8d28-9ce4e5192e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:33.675285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-668d450e-4410-406b-8d28-9ce4e5192e62 None None] MFA Rules not processed for user `e1e2b5863e804c7a9623828b6baaabe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:33.675285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-668d450e-4410-406b-8d28-9ce4e5192e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:33.764682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 957/1920] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:33.776038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be3a4-04ec-4282-ad0a-4ed45f87908b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:33.834369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be3a4-04ec-4282-ad0a-4ed45f87908b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:33.838036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495556-4179-4efe-abb1-53eb594e8f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:33.838687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495556-4179-4efe-abb1-53eb594e8f42 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:33.838972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495556-4179-4efe-abb1-53eb594e8f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:33.839248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495556-4179-4efe-abb1-53eb594e8f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:33.896200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc495556-4179-4efe-abb1-53eb594e8f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:33.897605 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc495556-4179-4efe-abb1-53eb594e8f42 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:33.909535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 964/1921] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:34.824709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d450e-4410-406b-8d28-9ce4e5192e62 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:34.836045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d450e-4410-406b-8d28-9ce4e5192e62 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:34.840241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a1e35-2079-4000-8ee4-ea2f68653374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:34.841146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a1e35-2079-4000-8ee4-ea2f68653374 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:34.841430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a1e35-2079-4000-8ee4-ea2f68653374 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:34.841753 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a1e35-2079-4000-8ee4-ea2f68653374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:34.844897 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1f7a1e35-2079-4000-8ee4-ea2f68653374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:34.912843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a1e35-2079-4000-8ee4-ea2f68653374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:34.914450 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a1e35-2079-4000-8ee4-ea2f68653374 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:34.927313 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 958/1922] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:37.000572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495556-4179-4efe-abb1-53eb594e8f42 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:37.010162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495556-4179-4efe-abb1-53eb594e8f42 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:37.014623 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79360e86-f9fb-4895-8397-56fc0e9bd221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:37.015268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79360e86-f9fb-4895-8397-56fc0e9bd221 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:37.015551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79360e86-f9fb-4895-8397-56fc0e9bd221 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:37.015855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79360e86-f9fb-4895-8397-56fc0e9bd221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:37.083369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79360e86-f9fb-4895-8397-56fc0e9bd221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:37.084824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79360e86-f9fb-4895-8397-56fc0e9bd221 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:37.097417 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 965/1923] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:38.214748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a1e35-2079-4000-8ee4-ea2f68653374 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:38.217285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1f7a1e35-2079-4000-8ee4-ea2f68653374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:38.282648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a1e35-2079-4000-8ee4-ea2f68653374 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:38.287328 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:38.288294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:38.288579 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:38.288850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] PATH_INFO: `/v3/users/e3d8bba8b5ef415ca8cdeb89d0114392` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:38.290257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d8bba8b5ef415ca8cdeb89d0114392)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:38.294873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:38.514482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d8bba8b5ef415ca8cdeb89d0114392'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:38.526051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d8bba8b5ef415ca8cdeb89d0114392'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:38.526736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d8bba8b5ef415ca8cdeb89d0114392'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:38.533708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d8bba8b5ef415ca8cdeb89d0114392'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:38.534360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d8bba8b5ef415ca8cdeb89d0114392'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:38.627892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 959/1924] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:38 2022] DELETE /identity/v3/users/e3d8bba8b5ef415ca8cdeb89d0114392 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:38.632947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c81a72-adf3-4dd8-aa82-d393d24faa3f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:38.633416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c81a72-adf3-4dd8-aa82-d393d24faa3f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:38.633529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c81a72-adf3-4dd8-aa82-d393d24faa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:38.651406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f9c81a72-adf3-4dd8-aa82-d393d24faa3f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:38.652624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f9c81a72-adf3-4dd8-aa82-d393d24faa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:38.799518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 966/1925] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:38.799812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:38.801301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:38.861632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796aafa-ce35-4943-88d6-b78977d748c0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:38.875846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1cba2-e664-4cbf-9a09-e70ad9b11dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:38.875846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1cba2-e664-4cbf-9a09-e70ad9b11dce service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:38.875846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1cba2-e664-4cbf-9a09-e70ad9b11dce service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:38.875846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1cba2-e664-4cbf-9a09-e70ad9b11dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:38.876524 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1cba2-e664-4cbf-9a09-e70ad9b11dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:38.877794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1cba2-e664-4cbf-9a09-e70ad9b11dce service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:38.887944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 960/1926] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:39.774289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c81a72-adf3-4dd8-aa82-d393d24faa3f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:39.776252 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f9c81a72-adf3-4dd8-aa82-d393d24faa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:39.791369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c81a72-adf3-4dd8-aa82-d393d24faa3f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:39.797394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:39.798619 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:39.798966 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:39.799275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] PATH_INFO: `/v3/projects/cc8e46d0a2374dca9c69fcdcb5b4ceab` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:39.800527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8e46d0a2374dca9c69fcdcb5b4ceab)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:39.802682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:39.954589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8e46d0a2374dca9c69fcdcb5b4ceab', 'request_id': 'req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.068758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8e46d0a2374dca9c69fcdcb5b4ceab', 'request_id': 'req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.077552 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8e46d0a2374dca9c69fcdcb5b4ceab', 'request_id': 'req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.091690 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] The token cache is being invalidate because project cc8e46d0a2374dca9c69fcdcb5b4ceab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:40.092165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.092273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1cba2-e664-4cbf-9a09-e70ad9b11dce service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:40.092894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.097505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-10e1cba2-e664-4cbf-9a09-e70ad9b11dce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:40.097807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 967/1927] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:39 2022] DELETE /identity/v3/projects/cc8e46d0a2374dca9c69fcdcb5b4ceab => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:40.106684 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1cba2-e664-4cbf-9a09-e70ad9b11dce service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:40.107628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:40.109204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:40.181743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b1a06-3b6a-4af1-abbc-3d191cb41052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:40.183539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1a06-3b6a-4af1-abbc-3d191cb41052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:40.183962 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1a06-3b6a-4af1-abbc-3d191cb41052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:40.185099 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1a06-3b6a-4af1-abbc-3d191cb41052 admin admin] PATH_INFO: `/v3/users/1fe5c71eb09b4c7ab2639f4183bbed20` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:40.186509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b1a06-3b6a-4af1-abbc-3d191cb41052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe5c71eb09b4c7ab2639f4183bbed20)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:40.188180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096d389-9ac2-40f2-80f9-48d2b9b48b9c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:40.188564 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b1a06-3b6a-4af1-abbc-3d191cb41052 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:40.193546 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a439673-2000-419e-b526-426478b89cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:40.194499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a439673-2000-419e-b526-426478b89cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:40.194858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a439673-2000-419e-b526-426478b89cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:40.195500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a439673-2000-419e-b526-426478b89cde admin admin] PATH_INFO: `/v3/users/3a0593bfdfde4785b27ca03b90d824c2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:40.196800 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a439673-2000-419e-b526-426478b89cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0593bfdfde4785b27ca03b90d824c2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:40.198746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a439673-2000-419e-b526-426478b89cde admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:40.345214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2a439673-2000-419e-b526-426478b89cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0593bfdfde4785b27ca03b90d824c2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.358281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2a439673-2000-419e-b526-426478b89cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0593bfdfde4785b27ca03b90d824c2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.369236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-de7b1a06-3b6a-4af1-abbc-3d191cb41052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe5c71eb09b4c7ab2639f4183bbed20'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.370980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-de7b1a06-3b6a-4af1-abbc-3d191cb41052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe5c71eb09b4c7ab2639f4183bbed20'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.371690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-de7b1a06-3b6a-4af1-abbc-3d191cb41052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe5c71eb09b4c7ab2639f4183bbed20'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.379677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-de7b1a06-3b6a-4af1-abbc-3d191cb41052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe5c71eb09b4c7ab2639f4183bbed20'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.380351 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-de7b1a06-3b6a-4af1-abbc-3d191cb41052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe5c71eb09b4c7ab2639f4183bbed20'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.466608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2a439673-2000-419e-b526-426478b89cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0593bfdfde4785b27ca03b90d824c2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.473878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2a439673-2000-419e-b526-426478b89cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0593bfdfde4785b27ca03b90d824c2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.477728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2a439673-2000-419e-b526-426478b89cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0593bfdfde4785b27ca03b90d824c2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:40.480453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 968/1928] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:40 2022] DELETE /identity/v3/users/3a0593bfdfde4785b27ca03b90d824c2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:40.482184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a439673-2000-419e-b526-426478b89cde admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:40.483385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2a439673-2000-419e-b526-426478b89cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:40.543343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a439673-2000-419e-b526-426478b89cde admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:40.549330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ecdf1-3300-486a-98a0-b39dff426b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:40.549983 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ecdf1-3300-486a-98a0-b39dff426b3e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:40.550261 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ecdf1-3300-486a-98a0-b39dff426b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:40.550534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ecdf1-3300-486a-98a0-b39dff426b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:40.552331 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eb4ecdf1-3300-486a-98a0-b39dff426b3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:40.564567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 961/1929] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:40 2022] DELETE /identity/v3/users/1fe5c71eb09b4c7ab2639f4183bbed20 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:40.568830 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946fbc2-421a-4ea9-8275-c0dffd9cd7d5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:40.569246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946fbc2-421a-4ea9-8275-c0dffd9cd7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:40.569620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946fbc2-421a-4ea9-8275-c0dffd9cd7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:40.587516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3946fbc2-421a-4ea9-8275-c0dffd9cd7d5 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:40.588711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3946fbc2-421a-4ea9-8275-c0dffd9cd7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:40.618415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ecdf1-3300-486a-98a0-b39dff426b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:40.619879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ecdf1-3300-486a-98a0-b39dff426b3e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:40.630571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 969/1930] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:40.646951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 962/1931] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:40.657347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ecdf1-3300-486a-98a0-b39dff426b3e service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:40.658923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eb4ecdf1-3300-486a-98a0-b39dff426b3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:40.733693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ecdf1-3300-486a-98a0-b39dff426b3e service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:40.798290 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1146d-7151-4028-a8f7-f6b87a1b8e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:40.798955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1146d-7151-4028-a8f7-f6b87a1b8e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:40.799110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1146d-7151-4028-a8f7-f6b87a1b8e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:40.799311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1146d-7151-4028-a8f7-f6b87a1b8e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:40.809386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1146d-7151-4028-a8f7-f6b87a1b8e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:40.815461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1146d-7151-4028-a8f7-f6b87a1b8e02 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:40.821508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 970/1932] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:40.908156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946fbc2-421a-4ea9-8275-c0dffd9cd7d5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:40.910392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3946fbc2-421a-4ea9-8275-c0dffd9cd7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:40.930860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946fbc2-421a-4ea9-8275-c0dffd9cd7d5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:40.936689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:40.938054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:40.938181 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:40.939109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] PATH_INFO: `/v3/projects/b29c205cefbc425fbaa036fd0f519445` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:40.940052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29c205cefbc425fbaa036fd0f519445)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:40.942198 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:41.106571 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29c205cefbc425fbaa036fd0f519445', 'request_id': 'req-c53341a6-2818-4459-afbf-00e87bc2713a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.196271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29c205cefbc425fbaa036fd0f519445', 'request_id': 'req-c53341a6-2818-4459-afbf-00e87bc2713a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.204666 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29c205cefbc425fbaa036fd0f519445', 'request_id': 'req-c53341a6-2818-4459-afbf-00e87bc2713a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.216056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] The token cache is being invalidate because project b29c205cefbc425fbaa036fd0f519445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:41.216613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.217496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53341a6-2818-4459-afbf-00e87bc2713a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.219786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 963/1933] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:40 2022] DELETE /identity/v3/projects/b29c205cefbc425fbaa036fd0f519445 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:41.224507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c962b1-7beb-44db-97a6-4f14484f78dc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:41.224798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c962b1-7beb-44db-97a6-4f14484f78dc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:41.225109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c962b1-7beb-44db-97a6-4f14484f78dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:41.243732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-08c962b1-7beb-44db-97a6-4f14484f78dc None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:41.245073 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-08c962b1-7beb-44db-97a6-4f14484f78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:41.304121 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 971/1934] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:41.312737 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a5be-c33a-415f-b2de-7baf75c63d29 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:41.313071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a5be-c33a-415f-b2de-7baf75c63d29 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:41.313353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a5be-c33a-415f-b2de-7baf75c63d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:41.323749 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c962b1-7beb-44db-97a6-4f14484f78dc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:41.325923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-08c962b1-7beb-44db-97a6-4f14484f78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:41.336562 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f3f1a5be-c33a-415f-b2de-7baf75c63d29 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:41.338723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f3f1a5be-c33a-415f-b2de-7baf75c63d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:41.346166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c962b1-7beb-44db-97a6-4f14484f78dc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:41.347619 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:41.348700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:41.348904 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:41.349211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] PATH_INFO: `/v3/projects/4f446c7dbda247c4b6ed31560ebecd9a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:41.350410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f446c7dbda247c4b6ed31560ebecd9a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:41.353655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:41.357451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 964/1935] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:41.362214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1a5be-c33a-415f-b2de-7baf75c63d29 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:41.375688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1a5be-c33a-415f-b2de-7baf75c63d29 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:41.381140 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f235263-c011-4561-b963-498942042535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:41.381817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f235263-c011-4561-b963-498942042535 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:41.382102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f235263-c011-4561-b963-498942042535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:41.382379 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f235263-c011-4561-b963-498942042535 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:41.383268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f235263-c011-4561-b963-498942042535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:41.384069 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f235263-c011-4561-b963-498942042535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:41.386112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f235263-c011-4561-b963-498942042535 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:41.399441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 965/1936] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:41.403525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f235263-c011-4561-b963-498942042535 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:41.414389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f235263-c011-4561-b963-498942042535 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:41.426639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5486ad-e858-485b-a0bc-1e4d3a78175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:41.427389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5486ad-e858-485b-a0bc-1e4d3a78175c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:41.427842 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5486ad-e858-485b-a0bc-1e4d3a78175c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:41.428124 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5486ad-e858-485b-a0bc-1e4d3a78175c admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:41.428852 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5486ad-e858-485b-a0bc-1e4d3a78175c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:41.430936 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5486ad-e858-485b-a0bc-1e4d3a78175c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:41.480217 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f446c7dbda247c4b6ed31560ebecd9a', 'request_id': 'req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.561010 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 966/1937] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:41 2022] POST /identity/v3/projects => generated 393 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:41.569131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5486ad-e858-485b-a0bc-1e4d3a78175c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:41.598241 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f446c7dbda247c4b6ed31560ebecd9a', 'request_id': 'req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.600154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f446c7dbda247c4b6ed31560ebecd9a', 'request_id': 'req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.613297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] The token cache is being invalidate because project 4f446c7dbda247c4b6ed31560ebecd9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:41.613592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.614323 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.616132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 972/1938] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:41 2022] DELETE /identity/v3/projects/4f446c7dbda247c4b6ed31560ebecd9a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:41.619843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:41.629676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:41.632816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5486ad-e858-485b-a0bc-1e4d3a78175c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:41.637707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d874bae-e603-4040-9c12-a781c6e3bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:41.638409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d874bae-e603-4040-9c12-a781c6e3bac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:41.638688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d874bae-e603-4040-9c12-a781c6e3bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:41.638965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d874bae-e603-4040-9c12-a781c6e3bac5 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:41.639653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d874bae-e603-4040-9c12-a781c6e3bac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:41.641642 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d874bae-e603-4040-9c12-a781c6e3bac5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:41.686645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed49ea-05f1-49e1-9393-ebbcdd85d3fd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:41.691531 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:41.692404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:41.692686 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:41.692956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] PATH_INFO: `/v3/users/85190321fd994cfebab5b1c028bd50e9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:41.694189 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85190321fd994cfebab5b1c028bd50e9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:41.696233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:41.713157 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 967/1939] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:41 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:41.717169 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d874bae-e603-4040-9c12-a781c6e3bac5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:41.724479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0d874bae-e603-4040-9c12-a781c6e3bac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:41.737032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d874bae-e603-4040-9c12-a781c6e3bac5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:41.741686 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026b490-1754-4c65-ade4-e08a1cd4e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:41.742343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b490-1754-4c65-ade4-e08a1cd4e549 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:41.742624 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b490-1754-4c65-ade4-e08a1cd4e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:41.742899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b490-1754-4c65-ade4-e08a1cd4e549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:41.743628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026b490-1754-4c65-ade4-e08a1cd4e549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:41.745224 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026b490-1754-4c65-ade4-e08a1cd4e549 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:41.757001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 968/1940] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:41.759708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026b490-1754-4c65-ade4-e08a1cd4e549 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:41.772765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026b490-1754-4c65-ade4-e08a1cd4e549 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:41.777542 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7c039-8411-4712-a3bb-d5b97415a5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:41.778812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7c039-8411-4712-a3bb-d5b97415a5cc admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:41.779097 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7c039-8411-4712-a3bb-d5b97415a5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:41.779370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7c039-8411-4712-a3bb-d5b97415a5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:41.780233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7c039-8411-4712-a3bb-d5b97415a5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:41.781977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7c039-8411-4712-a3bb-d5b97415a5cc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:41.792374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 969/1941] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:26:41.797586 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7c039-8411-4712-a3bb-d5b97415a5cc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:41.808824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7c039-8411-4712-a3bb-d5b97415a5cc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:41.814658 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e670a0f-157a-4c0a-9d4a-a9ee64183ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:41.818958 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670a0f-157a-4c0a-9d4a-a9ee64183ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:41.818958 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670a0f-157a-4c0a-9d4a-a9ee64183ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:41.818958 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670a0f-157a-4c0a-9d4a-a9ee64183ff8 admin admin] PATH_INFO: `/v3/projects/16dd147917ad4808a54e882c235fba3b/users/70f75fc12dc04064a041c96eb577c64f/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:41.832288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e670a0f-157a-4c0a-9d4a-a9ee64183ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16dd147917ad4808a54e882c235fba3b, user_id=70f75fc12dc04064a041c96eb577c64f, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:41.835075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e670a0f-157a-4c0a-9d4a-a9ee64183ff8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:41.851285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85190321fd994cfebab5b1c028bd50e9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.863902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85190321fd994cfebab5b1c028bd50e9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.923897 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 970/1942] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:41 2022] PUT /identity/v3/projects/16dd147917ad4808a54e882c235fba3b/users/70f75fc12dc04064a041c96eb577c64f/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:41.927484 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85190321fd994cfebab5b1c028bd50e9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.934420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0aa8-665a-4581-bf79-dc8cd9f5090e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:41.934796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0aa8-665a-4581-bf79-dc8cd9f5090e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:41.935079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0aa8-665a-4581-bf79-dc8cd9f5090e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:41.935426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85190321fd994cfebab5b1c028bd50e9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.936185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85190321fd994cfebab5b1c028bd50e9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:41.942672 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 973/1943] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:41 2022] DELETE /identity/v3/users/85190321fd994cfebab5b1c028bd50e9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:41.962845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d85c0aa8-665a-4581-bf79-dc8cd9f5090e None None] MFA Rules not processed for user `70f75fc12dc04064a041c96eb577c64f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:41.964122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d85c0aa8-665a-4581-bf79-dc8cd9f5090e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:42.033679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 971/1944] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:42.038395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:42.040039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:42.104904 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6911528-3f40-4a5b-867e-56e8c0b5aa20 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:42.110385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f30da-603f-4afd-8434-013e3d5eeb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:42.111062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f30da-603f-4afd-8434-013e3d5eeb93 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:42.111351 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f30da-603f-4afd-8434-013e3d5eeb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:42.113960 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f30da-603f-4afd-8434-013e3d5eeb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:42.113960 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f30da-603f-4afd-8434-013e3d5eeb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:42.114287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f30da-603f-4afd-8434-013e3d5eeb93 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:42.247081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 974/1945] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:42 2022] POST /identity/v3/projects => generated 393 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:42.248314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c0aa8-665a-4581-bf79-dc8cd9f5090e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:42.259647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c0aa8-665a-4581-bf79-dc8cd9f5090e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:42.331577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b976d8-b2c6-48a3-8db7-f93ebef70532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:42.332528 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b976d8-b2c6-48a3-8db7-f93ebef70532 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:42.332837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b976d8-b2c6-48a3-8db7-f93ebef70532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:42.333154 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b976d8-b2c6-48a3-8db7-f93ebef70532 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:42.333964 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b976d8-b2c6-48a3-8db7-f93ebef70532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:42.336549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b976d8-b2c6-48a3-8db7-f93ebef70532 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:42.382464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f30da-603f-4afd-8434-013e3d5eeb93 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:42.385870 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c55f30da-603f-4afd-8434-013e3d5eeb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:42.400404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f30da-603f-4afd-8434-013e3d5eeb93 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:42.415046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:42.415346 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 972/1946] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:42 2022] POST /identity/v3/users => generated 303 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:42.415939 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:42.418804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:42.418804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] PATH_INFO: `/v3/projects/8adcdcd8c2864c5cb9f60e6b97b0ccbe` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:42.418804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8adcdcd8c2864c5cb9f60e6b97b0ccbe)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:42.420164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:42.422271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b976d8-b2c6-48a3-8db7-f93ebef70532 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:42.432697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b976d8-b2c6-48a3-8db7-f93ebef70532 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:42.438122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645307a-9a48-43eb-aa5d-6a21f0b54002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:42.439268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645307a-9a48-43eb-aa5d-6a21f0b54002 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:42.439608 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645307a-9a48-43eb-aa5d-6a21f0b54002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:42.439893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645307a-9a48-43eb-aa5d-6a21f0b54002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:42.440627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645307a-9a48-43eb-aa5d-6a21f0b54002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:42.442513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645307a-9a48-43eb-aa5d-6a21f0b54002 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:42.453649 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 973/1947] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:26:42.457738 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645307a-9a48-43eb-aa5d-6a21f0b54002 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:42.470602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645307a-9a48-43eb-aa5d-6a21f0b54002 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:42.476236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762cea8-0c66-47d4-87ff-1d24b0877079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:42.487912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762cea8-0c66-47d4-87ff-1d24b0877079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:42.487912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762cea8-0c66-47d4-87ff-1d24b0877079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:42.487912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762cea8-0c66-47d4-87ff-1d24b0877079 admin admin] PATH_INFO: `/v3/projects/0fd5e04e43a748fa8d43b7d405862198/users/d128e43642d940d4823639c6cdbedd2d/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:42.505718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762cea8-0c66-47d4-87ff-1d24b0877079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd5e04e43a748fa8d43b7d405862198, user_id=d128e43642d940d4823639c6cdbedd2d, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:42.505718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762cea8-0c66-47d4-87ff-1d24b0877079 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:42.611463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 974/1948] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:42 2022] PUT /identity/v3/projects/0fd5e04e43a748fa8d43b7d405862198/users/d128e43642d940d4823639c6cdbedd2d/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:42.615285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762cea8-0c66-47d4-87ff-1d24b0877079 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:42.663791 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8adcdcd8c2864c5cb9f60e6b97b0ccbe', 'request_id': 'req-fa88916b-4e48-4237-b57b-c8b75267908b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:42.680552 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762cea8-0c66-47d4-87ff-1d24b0877079 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:42.748651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e5dec-3881-4679-a28f-962fd12029cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:42.749519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5dec-3881-4679-a28f-962fd12029cf admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:42.749802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5dec-3881-4679-a28f-962fd12029cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:42.750075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5dec-3881-4679-a28f-962fd12029cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:42.750803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e5dec-3881-4679-a28f-962fd12029cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:42.752432 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e5dec-3881-4679-a28f-962fd12029cf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:42.768429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 975/1949] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:42.770014 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e5dec-3881-4679-a28f-962fd12029cf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:42.794628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e5dec-3881-4679-a28f-962fd12029cf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:42.801441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e04f2-1007-438e-a399-db82aefdc9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:42.802555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e04f2-1007-438e-a399-db82aefdc9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:42.802932 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e04f2-1007-438e-a399-db82aefdc9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:42.803319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e04f2-1007-438e-a399-db82aefdc9e8 admin admin] PATH_INFO: `/v3/projects/0fd5e04e43a748fa8d43b7d405862198/users/d128e43642d940d4823639c6cdbedd2d/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:42.804514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8adcdcd8c2864c5cb9f60e6b97b0ccbe', 'request_id': 'req-fa88916b-4e48-4237-b57b-c8b75267908b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:42.806140 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e04f2-1007-438e-a399-db82aefdc9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd5e04e43a748fa8d43b7d405862198, user_id=d128e43642d940d4823639c6cdbedd2d, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:42.813139 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e04f2-1007-438e-a399-db82aefdc9e8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:42.815436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8adcdcd8c2864c5cb9f60e6b97b0ccbe', 'request_id': 'req-fa88916b-4e48-4237-b57b-c8b75267908b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:42.822286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 976/1950] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:42 2022] PUT /identity/v3/projects/0fd5e04e43a748fa8d43b7d405862198/users/d128e43642d940d4823639c6cdbedd2d/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:42.835670 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864e9d-5ded-4287-83f9-749d0651d8cb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:42.836202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864e9d-5ded-4287-83f9-749d0651d8cb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:42.836692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864e9d-5ded-4287-83f9-749d0651d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:42.841137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] The token cache is being invalidate because project 8adcdcd8c2864c5cb9f60e6b97b0ccbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:42.841558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:42.844078 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fa88916b-4e48-4237-b57b-c8b75267908b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:42.848599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 975/1951] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:42 2022] DELETE /identity/v3/projects/8adcdcd8c2864c5cb9f60e6b97b0ccbe => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:42.860904 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16fbbb-f810-4f34-bdd9-52a4cfb24a24 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:42.861513 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16fbbb-f810-4f34-bdd9-52a4cfb24a24 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:42.861513 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16fbbb-f810-4f34-bdd9-52a4cfb24a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:42.881342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e6864e9d-5ded-4287-83f9-749d0651d8cb None None] MFA Rules not processed for user `d128e43642d940d4823639c6cdbedd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:42.882730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e6864e9d-5ded-4287-83f9-749d0651d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:42.890409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bf16fbbb-f810-4f34-bdd9-52a4cfb24a24 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:42.892404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bf16fbbb-f810-4f34-bdd9-52a4cfb24a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:42.959045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 977/1952] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:42.959903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6864e9d-5ded-4287-83f9-749d0651d8cb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:42.961202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e6864e9d-5ded-4287-83f9-749d0651d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:42.974210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 976/1953] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:42.975095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16fbbb-f810-4f34-bdd9-52a4cfb24a24 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:42.976407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bf16fbbb-f810-4f34-bdd9-52a4cfb24a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:42.986489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6864e9d-5ded-4287-83f9-749d0651d8cb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:42.991182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774630b-9664-425a-a1db-3d2190402f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:42.996628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774630b-9664-425a-a1db-3d2190402f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:42.996628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774630b-9664-425a-a1db-3d2190402f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:42.996628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774630b-9664-425a-a1db-3d2190402f6d admin admin] PATH_INFO: `/v3/users/57470a1a1b11463c8bb7fc1f9c017235` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:42.996628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774630b-9664-425a-a1db-3d2190402f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57470a1a1b11463c8bb7fc1f9c017235)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:42.996628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774630b-9664-425a-a1db-3d2190402f6d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:43.036702 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16fbbb-f810-4f34-bdd9-52a4cfb24a24 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:43.041297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9c979-e44b-4de7-80a4-e67881e765d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:43.042010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9c979-e44b-4de7-80a4-e67881e765d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.042283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9c979-e44b-4de7-80a4-e67881e765d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.042599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9c979-e44b-4de7-80a4-e67881e765d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.053537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9c979-e44b-4de7-80a4-e67881e765d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:43.056548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9c979-e44b-4de7-80a4-e67881e765d0 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:43.094002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 977/1954] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:43.101206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e05b7-e440-4615-bdab-45f080aae1ef None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.101206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e05b7-e440-4615-bdab-45f080aae1ef None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.101206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e05b7-e440-4615-bdab-45f080aae1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.123647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-868e05b7-e440-4615-bdab-45f080aae1ef None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:43.124957 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-868e05b7-e440-4615-bdab-45f080aae1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:43.134587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 978/1955] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:43.140101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e05b7-e440-4615-bdab-45f080aae1ef None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:43.150438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e05b7-e440-4615-bdab-45f080aae1ef None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:43.155880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543a67e-662e-4788-8d3d-16eb888d6921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:43.156833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a67e-662e-4788-8d3d-16eb888d6921 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.157155 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a67e-662e-4788-8d3d-16eb888d6921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.157468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a67e-662e-4788-8d3d-16eb888d6921 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.158390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543a67e-662e-4788-8d3d-16eb888d6921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:43.158887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543a67e-662e-4788-8d3d-16eb888d6921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:43.160880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543a67e-662e-4788-8d3d-16eb888d6921 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:43.174662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 979/1956] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:26:43.175526 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543a67e-662e-4788-8d3d-16eb888d6921 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:43.177338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d543a67e-662e-4788-8d3d-16eb888d6921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:43.194480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543a67e-662e-4788-8d3d-16eb888d6921 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:43.198230 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d4d81-e3de-4dce-a2d8-2c3e4e9b11e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:43.199153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d4d81-e3de-4dce-a2d8-2c3e4e9b11e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.199442 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d4d81-e3de-4dce-a2d8-2c3e4e9b11e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.199727 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d4d81-e3de-4dce-a2d8-2c3e4e9b11e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.202225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e81d4d81-e3de-4dce-a2d8-2c3e4e9b11e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:43.264438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d4d81-e3de-4dce-a2d8-2c3e4e9b11e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:43.265805 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d4d81-e3de-4dce-a2d8-2c3e4e9b11e7 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:43.274809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 980/1957] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:43.275646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d4d81-e3de-4dce-a2d8-2c3e4e9b11e7 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:43.287320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3774630b-9664-425a-a1db-3d2190402f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57470a1a1b11463c8bb7fc1f9c017235'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:43.288006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d4d81-e3de-4dce-a2d8-2c3e4e9b11e7 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:43.296427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da46b0-355f-4826-9863-5c756d90ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:43.297321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da46b0-355f-4826-9863-5c756d90ec5b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.297453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da46b0-355f-4826-9863-5c756d90ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.298478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da46b0-355f-4826-9863-5c756d90ec5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.299704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da46b0-355f-4826-9863-5c756d90ec5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:43.301965 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da46b0-355f-4826-9863-5c756d90ec5b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:43.302868 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3774630b-9664-425a-a1db-3d2190402f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57470a1a1b11463c8bb7fc1f9c017235'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:43.304285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3774630b-9664-425a-a1db-3d2190402f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57470a1a1b11463c8bb7fc1f9c017235'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:43.313226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3774630b-9664-425a-a1db-3d2190402f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57470a1a1b11463c8bb7fc1f9c017235'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:43.314190 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3774630b-9664-425a-a1db-3d2190402f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57470a1a1b11463c8bb7fc1f9c017235'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:43.393743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 978/1958] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:42 2022] DELETE /identity/v3/users/57470a1a1b11463c8bb7fc1f9c017235 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:43.398294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7838b6-c221-4ac6-a24d-3833f67540cb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.398582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7838b6-c221-4ac6-a24d-3833f67540cb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.398864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7838b6-c221-4ac6-a24d-3833f67540cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.419607 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 981/1959] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:43 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:43.421855 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4d7838b6-c221-4ac6-a24d-3833f67540cb None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:43.421855 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4d7838b6-c221-4ac6-a24d-3833f67540cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:43.426085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da46b0-355f-4826-9863-5c756d90ec5b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:43.427788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c1da46b0-355f-4826-9863-5c756d90ec5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:43.485029 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 979/1960] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:43.494943 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7838b6-c221-4ac6-a24d-3833f67540cb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:43.496383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4d7838b6-c221-4ac6-a24d-3833f67540cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:43.501640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da46b0-355f-4826-9863-5c756d90ec5b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:43.506510 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd6e9e-0f0a-4c96-bccb-dc9ed595e97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:43.507219 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6e9e-0f0a-4c96-bccb-dc9ed595e97f admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.507507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6e9e-0f0a-4c96-bccb-dc9ed595e97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.507785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6e9e-0f0a-4c96-bccb-dc9ed595e97f admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.508486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd6e9e-0f0a-4c96-bccb-dc9ed595e97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:43.510441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd6e9e-0f0a-4c96-bccb-dc9ed595e97f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:43.557470 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7838b6-c221-4ac6-a24d-3833f67540cb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:43.561273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2828ef8-2acf-4d9d-9be9-46144af38acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:43.561919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828ef8-2acf-4d9d-9be9-46144af38acf service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.562203 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828ef8-2acf-4d9d-9be9-46144af38acf service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.562479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828ef8-2acf-4d9d-9be9-46144af38acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.572348 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2828ef8-2acf-4d9d-9be9-46144af38acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:43.574095 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2828ef8-2acf-4d9d-9be9-46144af38acf service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:43.584179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 980/1961] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:26:43.667409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 982/1962] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:43 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:43.671416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2828ef8-2acf-4d9d-9be9-46144af38acf service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:43.682156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2828ef8-2acf-4d9d-9be9-46144af38acf service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:43.687535 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b1c31-cb3e-4419-9bee-f7b7f23480a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:43.688215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b1c31-cb3e-4419-9bee-f7b7f23480a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.688502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b1c31-cb3e-4419-9bee-f7b7f23480a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.688766 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b1c31-cb3e-4419-9bee-f7b7f23480a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.690061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b1c31-cb3e-4419-9bee-f7b7f23480a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:43.691730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b1c31-cb3e-4419-9bee-f7b7f23480a9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:43.703392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 981/1963] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:43.707762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd6e9e-0f0a-4c96-bccb-dc9ed595e97f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:43.730985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd6e9e-0f0a-4c96-bccb-dc9ed595e97f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:43.736866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b459c-cd70-49a3-a3b2-f4c56154efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:43.737743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b459c-cd70-49a3-a3b2-f4c56154efbf admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.738037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b459c-cd70-49a3-a3b2-f4c56154efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.738325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b459c-cd70-49a3-a3b2-f4c56154efbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.739094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b459c-cd70-49a3-a3b2-f4c56154efbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:43.740822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b459c-cd70-49a3-a3b2-f4c56154efbf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:43.753019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 983/1964] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:43.757008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b1c31-cb3e-4419-9bee-f7b7f23480a9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:43.768111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b1c31-cb3e-4419-9bee-f7b7f23480a9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:43.775287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba19d18-c1b4-4dcd-a6c0-a38099393932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:43.776426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba19d18-c1b4-4dcd-a6c0-a38099393932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.776811 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba19d18-c1b4-4dcd-a6c0-a38099393932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.777239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba19d18-c1b4-4dcd-a6c0-a38099393932 admin admin] PATH_INFO: `/v3/projects/5ed5a1d8ef8a416c9545cda91c3c905d/users/4e3b6cb06391485ba40a119082b137ea/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.795547 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba19d18-c1b4-4dcd-a6c0-a38099393932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed5a1d8ef8a416c9545cda91c3c905d, user_id=4e3b6cb06391485ba40a119082b137ea, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:43.798250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba19d18-c1b4-4dcd-a6c0-a38099393932 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:43.925083 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 982/1965] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:43 2022] PUT /identity/v3/projects/5ed5a1d8ef8a416c9545cda91c3c905d/users/4e3b6cb06391485ba40a119082b137ea/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:43.935963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9826ac3-d8b1-4c4e-9448-63063fbf0d51 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:43.936820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9826ac3-d8b1-4c4e-9448-63063fbf0d51 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:43.937606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9826ac3-d8b1-4c4e-9448-63063fbf0d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:43.975715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c9826ac3-d8b1-4c4e-9448-63063fbf0d51 None None] MFA Rules not processed for user `4e3b6cb06391485ba40a119082b137ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:43.976991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c9826ac3-d8b1-4c4e-9448-63063fbf0d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:44.045175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 984/1966] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:44.049721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba19d18-c1b4-4dcd-a6c0-a38099393932 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:44.129076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba19d18-c1b4-4dcd-a6c0-a38099393932 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:44.129226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9826ac3-d8b1-4c4e-9448-63063fbf0d51 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:44.129226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c9826ac3-d8b1-4c4e-9448-63063fbf0d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:44.129464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d261c68-63a3-4570-864a-3c8e74b28a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:44.129464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d261c68-63a3-4570-864a-3c8e74b28a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:44.129464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d261c68-63a3-4570-864a-3c8e74b28a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:44.129464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d261c68-63a3-4570-864a-3c8e74b28a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:44.129799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d261c68-63a3-4570-864a-3c8e74b28a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:44.129799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d261c68-63a3-4570-864a-3c8e74b28a19 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:44.136177 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9826ac3-d8b1-4c4e-9448-63063fbf0d51 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:44.142236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:44.143212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:44.143536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:44.143895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] PATH_INFO: `/v3/projects/f2012c091248449fb181bd07e1b29117` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:44.148102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2012c091248449fb181bd07e1b29117)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:44.148102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:44.228316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 983/1967] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:44 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:44.232588 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d261c68-63a3-4570-864a-3c8e74b28a19 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:44.268644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2012c091248449fb181bd07e1b29117', 'request_id': 'req-307b564e-4ea0-42b4-8ae2-28c7ea572efe'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:44.295602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d261c68-63a3-4570-864a-3c8e74b28a19 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:44.333498 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2012c091248449fb181bd07e1b29117', 'request_id': 'req-307b564e-4ea0-42b4-8ae2-28c7ea572efe'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:44.341956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2012c091248449fb181bd07e1b29117', 'request_id': 'req-307b564e-4ea0-42b4-8ae2-28c7ea572efe'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:44.352874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] The token cache is being invalidate because project f2012c091248449fb181bd07e1b29117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:44.353216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:44.353850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:44.355405 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 985/1968] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:44 2022] DELETE /identity/v3/projects/f2012c091248449fb181bd07e1b29117 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:44.356469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c49387-11c1-49e4-adc7-09f30133a0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:44.357478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c49387-11c1-49e4-adc7-09f30133a0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:44.357902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c49387-11c1-49e4-adc7-09f30133a0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:44.358039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c49387-11c1-49e4-adc7-09f30133a0b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:44.358751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c49387-11c1-49e4-adc7-09f30133a0b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:44.360453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:44.360893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c49387-11c1-49e4-adc7-09f30133a0b8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:44.361977 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:44.375443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b564e-4ea0-42b4-8ae2-28c7ea572efe admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:44.380878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:44.381777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:44.382061 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:44.382336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] PATH_INFO: `/v3/users/1754c40b27c143c9a7d2a341d7e3b1f9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:44.383543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1754c40b27c143c9a7d2a341d7e3b1f9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:44.385627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:44.497533 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 984/1969] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:44 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:44.503103 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c49387-11c1-49e4-adc7-09f30133a0b8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:44.504779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-46c49387-11c1-49e4-adc7-09f30133a0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:44.516627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c49387-11c1-49e4-adc7-09f30133a0b8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:44.521214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87527c49-733e-4c4f-a3ed-bcad4aac6f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:44.521864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87527c49-733e-4c4f-a3ed-bcad4aac6f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:44.522145 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87527c49-733e-4c4f-a3ed-bcad4aac6f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:44.522437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87527c49-733e-4c4f-a3ed-bcad4aac6f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:44.523123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87527c49-733e-4c4f-a3ed-bcad4aac6f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:44.524710 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87527c49-733e-4c4f-a3ed-bcad4aac6f89 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:44.534826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 985/1970] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:26:44.538843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87527c49-733e-4c4f-a3ed-bcad4aac6f89 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:44.548839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87527c49-733e-4c4f-a3ed-bcad4aac6f89 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:44.553507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c31c14-bc5c-4918-8a73-c6c9cfe06147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:44.554356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c31c14-bc5c-4918-8a73-c6c9cfe06147 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:44.554633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c31c14-bc5c-4918-8a73-c6c9cfe06147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:44.554902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c31c14-bc5c-4918-8a73-c6c9cfe06147 admin admin] PATH_INFO: `/v3/projects/b87c8ce6ed334f449739a73f42a17a4b/users/598b9cd726294e628c77e55495d2dedb/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:44.570499 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c31c14-bc5c-4918-8a73-c6c9cfe06147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87c8ce6ed334f449739a73f42a17a4b, user_id=598b9cd726294e628c77e55495d2dedb, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:44.573179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c31c14-bc5c-4918-8a73-c6c9cfe06147 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:44.634288 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1754c40b27c143c9a7d2a341d7e3b1f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:44.645923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1754c40b27c143c9a7d2a341d7e3b1f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:44.690186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 986/1971] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:44 2022] PUT /identity/v3/projects/b87c8ce6ed334f449739a73f42a17a4b/users/598b9cd726294e628c77e55495d2dedb/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:44.694059 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c31c14-bc5c-4918-8a73-c6c9cfe06147 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:44.753622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c31c14-bc5c-4918-8a73-c6c9cfe06147 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:44.758419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878bfec-9db1-405b-83da-7ec8592f101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:44.759079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878bfec-9db1-405b-83da-7ec8592f101e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:44.759361 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878bfec-9db1-405b-83da-7ec8592f101e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:44.759635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878bfec-9db1-405b-83da-7ec8592f101e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:44.760352 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878bfec-9db1-405b-83da-7ec8592f101e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:44.762043 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878bfec-9db1-405b-83da-7ec8592f101e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:44.771592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 987/1972] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:26:44.775749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878bfec-9db1-405b-83da-7ec8592f101e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:44.786662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878bfec-9db1-405b-83da-7ec8592f101e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:44.791693 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb28fa2-993b-40f0-8e38-e833a48867e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:44.792590 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb28fa2-993b-40f0-8e38-e833a48867e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:44.792920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb28fa2-993b-40f0-8e38-e833a48867e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:44.793259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb28fa2-993b-40f0-8e38-e833a48867e9 admin admin] PATH_INFO: `/v3/projects/b87c8ce6ed334f449739a73f42a17a4b/users/598b9cd726294e628c77e55495d2dedb/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:44.796123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb28fa2-993b-40f0-8e38-e833a48867e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87c8ce6ed334f449739a73f42a17a4b, user_id=598b9cd726294e628c77e55495d2dedb, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:44.798735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb28fa2-993b-40f0-8e38-e833a48867e9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:44.808568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 988/1973] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:44 2022] PUT /identity/v3/projects/b87c8ce6ed334f449739a73f42a17a4b/users/598b9cd726294e628c77e55495d2dedb/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:44.819757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b3bd9-c91d-46c5-b473-ee1b91bdf3a2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:44.820046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b3bd9-c91d-46c5-b473-ee1b91bdf3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:44.820440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b3bd9-c91d-46c5-b473-ee1b91bdf3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:44.820571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1754c40b27c143c9a7d2a341d7e3b1f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:44.828664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1754c40b27c143c9a7d2a341d7e3b1f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:44.830979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1754c40b27c143c9a7d2a341d7e3b1f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:44.835947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 986/1974] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:44 2022] DELETE /identity/v3/users/1754c40b27c143c9a7d2a341d7e3b1f9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:44.849585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-032b3bd9-c91d-46c5-b473-ee1b91bdf3a2 None None] MFA Rules not processed for user `598b9cd726294e628c77e55495d2dedb`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:44.850829 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-032b3bd9-c91d-46c5-b473-ee1b91bdf3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:44.936577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 989/1975] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:44.944681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:44.946211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:45.007202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23dd4a-693f-49f2-a4a1-528f7a694df9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:45.017943 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29be57-f971-4b0e-9bc6-e837099f6133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:45.018832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29be57-f971-4b0e-9bc6-e837099f6133 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:45.019216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29be57-f971-4b0e-9bc6-e837099f6133 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:45.019613 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29be57-f971-4b0e-9bc6-e837099f6133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:45.031109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29be57-f971-4b0e-9bc6-e837099f6133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:45.032602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29be57-f971-4b0e-9bc6-e837099f6133 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:45.048604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 987/1976] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:45.366374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b3bd9-c91d-46c5-b473-ee1b91bdf3a2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:45.367892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-032b3bd9-c91d-46c5-b473-ee1b91bdf3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:45.444092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b3bd9-c91d-46c5-b473-ee1b91bdf3a2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:45.449057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:45.450523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:45.450804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:45.451077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] PATH_INFO: `/v3/projects/55376bb1b07f465491df72d4998544a3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:45.452255 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55376bb1b07f465491df72d4998544a3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:45.454190 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:45.593662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55376bb1b07f465491df72d4998544a3', 'request_id': 'req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:45.774687 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55376bb1b07f465491df72d4998544a3', 'request_id': 'req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:45.782661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55376bb1b07f465491df72d4998544a3', 'request_id': 'req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:45.794467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] The token cache is being invalidate because project 55376bb1b07f465491df72d4998544a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:45.794878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:45.795572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:45.797154 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 990/1977] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:45 2022] DELETE /identity/v3/projects/55376bb1b07f465491df72d4998544a3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:45.801121 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29be57-f971-4b0e-9bc6-e837099f6133 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:45.812704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29be57-f971-4b0e-9bc6-e837099f6133 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:45.876329 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:45.877480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:45.877764 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:45.878037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] PATH_INFO: `/v3/users/2b6c5402b514450abfeab0485ed1c7cc` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:45.879243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6c5402b514450abfeab0485ed1c7cc)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:45.881230 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:46.159891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6c5402b514450abfeab0485ed1c7cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:46.179694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6c5402b514450abfeab0485ed1c7cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:46.294546 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6c5402b514450abfeab0485ed1c7cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:46.302944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6c5402b514450abfeab0485ed1c7cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:46.303585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6c5402b514450abfeab0485ed1c7cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:46.309818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 988/1978] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:45 2022] DELETE /identity/v3/users/2b6c5402b514450abfeab0485ed1c7cc => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:46.490734 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:46.492407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:46.571415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693696e-e502-4dd3-8eda-e8ef5eaca6c8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:46.642761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305c7b6-be47-4f38-bee0-52bd7a0a4033 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '598b9cd726294e628c77e55495d2dedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b87c8ce6ed334f449739a73f42a17a4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:46.643763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305c7b6-be47-4f38-bee0-52bd7a0a4033 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:46.644213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305c7b6-be47-4f38-bee0-52bd7a0a4033 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:46.644697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305c7b6-be47-4f38-bee0-52bd7a0a4033 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:46.645610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305c7b6-be47-4f38-bee0-52bd7a0a4033 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:46.646067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305c7b6-be47-4f38-bee0-52bd7a0a4033 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:46.649717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305c7b6-be47-4f38-bee0-52bd7a0a4033 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:46.667813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 991/1979] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:46.669127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:46.674650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:46.686523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df0609-d66c-4203-9c66-ba07f4798eac admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:46.692012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89c988-f705-451b-8594-5f65fed8cc8f tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '598b9cd726294e628c77e55495d2dedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b87c8ce6ed334f449739a73f42a17a4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:46.692635 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c988-f705-451b-8594-5f65fed8cc8f tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:46.692924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c988-f705-451b-8594-5f65fed8cc8f tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:46.693388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c988-f705-451b-8594-5f65fed8cc8f tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:46.694077 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89c988-f705-451b-8594-5f65fed8cc8f tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:46.695994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89c988-f705-451b-8594-5f65fed8cc8f tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:46.758909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305c7b6-be47-4f38-bee0-52bd7a0a4033 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:46.760742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2305c7b6-be47-4f38-bee0-52bd7a0a4033 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:46.812172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 989/1980] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:46 2022] POST /identity/v3/projects => generated 354 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:46.816459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89c988-f705-451b-8594-5f65fed8cc8f tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:46.847500 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305c7b6-be47-4f38-bee0-52bd7a0a4033 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:46.891700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89c988-f705-451b-8594-5f65fed8cc8f tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:46.900514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5034f3-1289-41ed-adea-49b0bdeb76e1 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '598b9cd726294e628c77e55495d2dedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b87c8ce6ed334f449739a73f42a17a4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:46.901234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5034f3-1289-41ed-adea-49b0bdeb76e1 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:46.901668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5034f3-1289-41ed-adea-49b0bdeb76e1 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:46.901958 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5034f3-1289-41ed-adea-49b0bdeb76e1 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:46.902708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5034f3-1289-41ed-adea-49b0bdeb76e1 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:46.903027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5034f3-1289-41ed-adea-49b0bdeb76e1 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:46.905468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5034f3-1289-41ed-adea-49b0bdeb76e1 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:46.921316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 990/1981] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:26:46.924752 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:46.926398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:46.926844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:46.927397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] PATH_INFO: `/v3/projects/24b9430f62fc43da89b2421ce943894c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:46.929348 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b9430f62fc43da89b2421ce943894c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:46.932603 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:46.961543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5034f3-1289-41ed-adea-49b0bdeb76e1 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:46.972708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5034f3-1289-41ed-adea-49b0bdeb76e1 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:46.978007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '598b9cd726294e628c77e55495d2dedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b87c8ce6ed334f449739a73f42a17a4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:46.978886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:46.979221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:46.979503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] PATH_INFO: `/v3/projects/116d1e38e3d94c38a80aca1a26f4a824` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:46.980799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: Authorizing `identity:delete_project(project_id=116d1e38e3d94c38a80aca1a26f4a824)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:46.982863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:47.066723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b9430f62fc43da89b2421ce943894c', 'request_id': 'req-9d1bf257-2453-4442-8546-64a1038c19d3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.089153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116d1e38e3d94c38a80aca1a26f4a824', 'request_id': 'req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.197557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b9430f62fc43da89b2421ce943894c', 'request_id': 'req-9d1bf257-2453-4442-8546-64a1038c19d3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.205475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b9430f62fc43da89b2421ce943894c', 'request_id': 'req-9d1bf257-2453-4442-8546-64a1038c19d3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.215500 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] The token cache is being invalidate because project 24b9430f62fc43da89b2421ce943894c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:47.215790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.216467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9d1bf257-2453-4442-8546-64a1038c19d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.218529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 992/1982] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:46 2022] DELETE /identity/v3/projects/24b9430f62fc43da89b2421ce943894c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:47.225387 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccb73f-2266-4d74-a332-f5f68a369e39 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:47.225682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccb73f-2266-4d74-a332-f5f68a369e39 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:47.225960 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccb73f-2266-4d74-a332-f5f68a369e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:47.245794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cdccb73f-2266-4d74-a332-f5f68a369e39 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:47.247008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cdccb73f-2266-4d74-a332-f5f68a369e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:47.309550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 993/1983] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:47.314820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116d1e38e3d94c38a80aca1a26f4a824', 'request_id': 'req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.318220 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f8bf-795b-4425-ab48-844aaafbea8a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:47.318515 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f8bf-795b-4425-ab48-844aaafbea8a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:47.318790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f8bf-795b-4425-ab48-844aaafbea8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:47.323870 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116d1e38e3d94c38a80aca1a26f4a824', 'request_id': 'req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.337392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] The token cache is being invalidate because project 116d1e38e3d94c38a80aca1a26f4a824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:47.337739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-78d0f8bf-795b-4425-ab48-844aaafbea8a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:47.337843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.338599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.338892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-78d0f8bf-795b-4425-ab48-844aaafbea8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:47.340654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 991/1984] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:46 2022] DELETE /identity/v3/projects/116d1e38e3d94c38a80aca1a26f4a824 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:47.352856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 994/1985] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:47.357155 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:47.373037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b4af-ebc8-4032-b9c1-d8f17b81abd0 tempest-VolumeQuotaClassesTest-1975418265 tempest-VolumeQuotaClassesTest-1975418265-project-admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:47.379173 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cff094-fa1d-4e59-bb26-5c0385a54ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:47.380204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cff094-fa1d-4e59-bb26-5c0385a54ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:47.380676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cff094-fa1d-4e59-bb26-5c0385a54ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:47.381171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cff094-fa1d-4e59-bb26-5c0385a54ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:47.382468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cff094-fa1d-4e59-bb26-5c0385a54ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:47.383287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cff094-fa1d-4e59-bb26-5c0385a54ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:47.385227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cff094-fa1d-4e59-bb26-5c0385a54ffc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:47.398045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 992/1986] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:47.402453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0f8bf-795b-4425-ab48-844aaafbea8a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:47.412412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0f8bf-795b-4425-ab48-844aaafbea8a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:47.417430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaa4e2-37d0-48d3-9b03-7e394277dc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:47.418228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaa4e2-37d0-48d3-9b03-7e394277dc21 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:47.418574 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaa4e2-37d0-48d3-9b03-7e394277dc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:47.418853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaa4e2-37d0-48d3-9b03-7e394277dc21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:47.419568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaa4e2-37d0-48d3-9b03-7e394277dc21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:47.422507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaa4e2-37d0-48d3-9b03-7e394277dc21 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:47.509824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cff094-fa1d-4e59-bb26-5c0385a54ffc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:47.511679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-73cff094-fa1d-4e59-bb26-5c0385a54ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:47.525172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cff094-fa1d-4e59-bb26-5c0385a54ffc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:47.530206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51edccd-2d0b-4882-885b-61d062753d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:47.531101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51edccd-2d0b-4882-885b-61d062753d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:47.531383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51edccd-2d0b-4882-885b-61d062753d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:47.531656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51edccd-2d0b-4882-885b-61d062753d6c admin admin] PATH_INFO: `/v3/users/7035b93106a4452999c1f3aa409d4614` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:47.532902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51edccd-2d0b-4882-885b-61d062753d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7035b93106a4452999c1f3aa409d4614)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:47.534880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51edccd-2d0b-4882-885b-61d062753d6c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:47.562141 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 995/1987] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:47 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:47.563866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaa4e2-37d0-48d3-9b03-7e394277dc21 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:47.630773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaa4e2-37d0-48d3-9b03-7e394277dc21 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:47.638107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a85af-61a3-4a14-88c9-4803e0d5b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:47.638939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a85af-61a3-4a14-88c9-4803e0d5b5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:47.639300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a85af-61a3-4a14-88c9-4803e0d5b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:47.639797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a85af-61a3-4a14-88c9-4803e0d5b5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:47.641123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a85af-61a3-4a14-88c9-4803e0d5b5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:47.642887 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a85af-61a3-4a14-88c9-4803e0d5b5d2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:47.742984 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d51edccd-2d0b-4882-885b-61d062753d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7035b93106a4452999c1f3aa409d4614'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.750134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 996/1988] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:47 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:47.751658 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a85af-61a3-4a14-88c9-4803e0d5b5d2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:47.760167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d51edccd-2d0b-4882-885b-61d062753d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7035b93106a4452999c1f3aa409d4614'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.763626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a85af-61a3-4a14-88c9-4803e0d5b5d2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:47.768856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1d303-e09e-4ef9-9c96-e890a8527386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:47.770003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1d303-e09e-4ef9-9c96-e890a8527386 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:47.770415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1d303-e09e-4ef9-9c96-e890a8527386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:47.770415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1d303-e09e-4ef9-9c96-e890a8527386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:47.774144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1d303-e09e-4ef9-9c96-e890a8527386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:47.774144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1d303-e09e-4ef9-9c96-e890a8527386 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:47.787233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 997/1989] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:47.788719 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1d303-e09e-4ef9-9c96-e890a8527386 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:47.799824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1d303-e09e-4ef9-9c96-e890a8527386 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:47.804802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b4ae3-2d2f-4138-9b03-248b034fd7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:47.805560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b4ae3-2d2f-4138-9b03-248b034fd7bf admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:47.805867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b4ae3-2d2f-4138-9b03-248b034fd7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:47.806141 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b4ae3-2d2f-4138-9b03-248b034fd7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:47.806883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b4ae3-2d2f-4138-9b03-248b034fd7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:47.808466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b4ae3-2d2f-4138-9b03-248b034fd7bf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:47.820077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 998/1990] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:26:47.824254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b4ae3-2d2f-4138-9b03-248b034fd7bf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:47.833999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b4ae3-2d2f-4138-9b03-248b034fd7bf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:47.838691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c6be1-863f-48df-9189-166505147030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:47.839558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c6be1-863f-48df-9189-166505147030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:47.839839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c6be1-863f-48df-9189-166505147030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:47.840109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c6be1-863f-48df-9189-166505147030 admin admin] PATH_INFO: `/v3/projects/6d5c7c86d23b4beba850f169f412760d/users/762d950c213a4794aca9afbaa82f2a69/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:47.853401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d51edccd-2d0b-4882-885b-61d062753d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7035b93106a4452999c1f3aa409d4614'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.855969 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c6be1-863f-48df-9189-166505147030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5c7c86d23b4beba850f169f412760d, user_id=762d950c213a4794aca9afbaa82f2a69, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:47.859278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c6be1-863f-48df-9189-166505147030 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:47.862331 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d51edccd-2d0b-4882-885b-61d062753d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7035b93106a4452999c1f3aa409d4614'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.863213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d51edccd-2d0b-4882-885b-61d062753d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7035b93106a4452999c1f3aa409d4614'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:47.869473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 993/1991] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:47 2022] DELETE /identity/v3/users/7035b93106a4452999c1f3aa409d4614 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:47.874338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc961c4-51e1-4f8d-88d6-3659fa0e6728 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:47.874703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc961c4-51e1-4f8d-88d6-3659fa0e6728 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:47.874985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc961c4-51e1-4f8d-88d6-3659fa0e6728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:47.892158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7dc961c4-51e1-4f8d-88d6-3659fa0e6728 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:47.893440 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7dc961c4-51e1-4f8d-88d6-3659fa0e6728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:47.960695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 994/1992] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:47.961786 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc961c4-51e1-4f8d-88d6-3659fa0e6728 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:47.963203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7dc961c4-51e1-4f8d-88d6-3659fa0e6728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:47.972023 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 999/1993] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:47 2022] PUT /identity/v3/projects/6d5c7c86d23b4beba850f169f412760d/users/762d950c213a4794aca9afbaa82f2a69/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:47.975638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c6be1-863f-48df-9189-166505147030 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:47.975638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9a7c6be1-863f-48df-9189-166505147030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:47.976837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc961c4-51e1-4f8d-88d6-3659fa0e6728 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:48.042368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:48.042368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:48.042368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:48.042368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] PATH_INFO: `/v3/users/ed8ac4a1b8744ff2b42747ddd7cb46d6` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:48.043082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8ac4a1b8744ff2b42747ddd7cb46d6)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:48.045052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:48.051262 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c6be1-863f-48df-9189-166505147030 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:48.055114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec2d9b-e90c-42a9-b7cf-f8b8fb7470ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:48.055763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec2d9b-e90c-42a9-b7cf-f8b8fb7470ed service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:48.056411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec2d9b-e90c-42a9-b7cf-f8b8fb7470ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:48.056411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec2d9b-e90c-42a9-b7cf-f8b8fb7470ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:48.066345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec2d9b-e90c-42a9-b7cf-f8b8fb7470ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:48.067795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec2d9b-e90c-42a9-b7cf-f8b8fb7470ed service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:48.078137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1000/1994] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:48.079721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa843d-417d-45a8-a071-5ca8ea6d9ae9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:48.080016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa843d-417d-45a8-a071-5ca8ea6d9ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:48.080295 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa843d-417d-45a8-a071-5ca8ea6d9ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:48.110240 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-89fa843d-417d-45a8-a071-5ca8ea6d9ae9 None None] MFA Rules not processed for user `762d950c213a4794aca9afbaa82f2a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:48.111922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-89fa843d-417d-45a8-a071-5ca8ea6d9ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:48.180782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1001/1995] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:48.181661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa843d-417d-45a8-a071-5ca8ea6d9ae9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:48.182969 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-89fa843d-417d-45a8-a071-5ca8ea6d9ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:48.196838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa843d-417d-45a8-a071-5ca8ea6d9ae9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:48.202010 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:48.203151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:48.203434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:48.205282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] PATH_INFO: `/v3/users/4e3b6cb06391485ba40a119082b137ea` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:48.205282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e3b6cb06391485ba40a119082b137ea)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:48.205724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8ac4a1b8744ff2b42747ddd7cb46d6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.206924 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:48.218508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8ac4a1b8744ff2b42747ddd7cb46d6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.306160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8ac4a1b8744ff2b42747ddd7cb46d6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.314564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8ac4a1b8744ff2b42747ddd7cb46d6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.318075 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8ac4a1b8744ff2b42747ddd7cb46d6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.320757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 995/1996] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:47 2022] DELETE /identity/v3/users/ed8ac4a1b8744ff2b42747ddd7cb46d6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:48.321816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:48.325333 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:48.391434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e3b6cb06391485ba40a119082b137ea'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.397925 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0c7bd-e46e-4c2f-93da-add7061bae5e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:48.402865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ba634-e0c9-41ce-8f03-1c32e3dfa0d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:48.403590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba634-e0c9-41ce-8f03-1c32e3dfa0d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:48.403869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba634-e0c9-41ce-8f03-1c32e3dfa0d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:48.404278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba634-e0c9-41ce-8f03-1c32e3dfa0d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:48.405581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e3b6cb06391485ba40a119082b137ea'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.406340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e3b6cb06391485ba40a119082b137ea'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.407361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c86ba634-e0c9-41ce-8f03-1c32e3dfa0d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:48.414783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e3b6cb06391485ba40a119082b137ea'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.416241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e3b6cb06391485ba40a119082b137ea'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.476755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ba634-e0c9-41ce-8f03-1c32e3dfa0d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:48.478227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ba634-e0c9-41ce-8f03-1c32e3dfa0d4 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:48.488199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 996/1997] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:48.492999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1002/1998] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:48 2022] DELETE /identity/v3/users/4e3b6cb06391485ba40a119082b137ea => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:48.494965 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb7771-a666-4e38-96d0-06c1a04d82a9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:48.495656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb7771-a666-4e38-96d0-06c1a04d82a9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:48.495656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb7771-a666-4e38-96d0-06c1a04d82a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:48.515629 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-78fb7771-a666-4e38-96d0-06c1a04d82a9 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:48.516892 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-78fb7771-a666-4e38-96d0-06c1a04d82a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:48.566346 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:48.568466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:48.592268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 997/1999] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:48.602389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb7771-a666-4e38-96d0-06c1a04d82a9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:48.605268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-78fb7771-a666-4e38-96d0-06c1a04d82a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:48.686998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb7771-a666-4e38-96d0-06c1a04d82a9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:48.688472 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df9ec8-484e-4e62-90c0-b672b28c8673 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:48.692026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19472a7b-a82b-47b9-b17b-e2afc1c1eca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:48.692714 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472a7b-a82b-47b9-b17b-e2afc1c1eca1 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:48.693065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472a7b-a82b-47b9-b17b-e2afc1c1eca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:48.693328 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472a7b-a82b-47b9-b17b-e2afc1c1eca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:48.693552 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:48.694411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:48.694690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:48.695132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] PATH_INFO: `/v3/projects/5a873402f7d8412093a8e47e962a307a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:48.696279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a873402f7d8412093a8e47e962a307a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:48.698285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:48.704555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19472a7b-a82b-47b9-b17b-e2afc1c1eca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:48.706170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19472a7b-a82b-47b9-b17b-e2afc1c1eca1 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:48.716368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 998/2000] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:48.717867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19472a7b-a82b-47b9-b17b-e2afc1c1eca1 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:48.719758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-19472a7b-a82b-47b9-b17b-e2afc1c1eca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:48.741944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19472a7b-a82b-47b9-b17b-e2afc1c1eca1 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:48.748748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:48.749813 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:48.750086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:48.750590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] PATH_INFO: `/v3/projects/ad74a5a84650412abfbb212fe4435e2b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:48.752026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad74a5a84650412abfbb212fe4435e2b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:48.754114 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:48.850363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a873402f7d8412093a8e47e962a307a', 'request_id': 'req-39412f0c-4e42-4bf9-ab17-c17b7c558942'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.879311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad74a5a84650412abfbb212fe4435e2b', 'request_id': 'req-5bb52c6e-720e-487f-ad20-f29ace4febd4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.947303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a873402f7d8412093a8e47e962a307a', 'request_id': 'req-39412f0c-4e42-4bf9-ab17-c17b7c558942'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.959878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a873402f7d8412093a8e47e962a307a', 'request_id': 'req-39412f0c-4e42-4bf9-ab17-c17b7c558942'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.972189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] The token cache is being invalidate because project 5a873402f7d8412093a8e47e962a307a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:48.972189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.972891 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:48.977745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1003/2001] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:48 2022] DELETE /identity/v3/projects/5a873402f7d8412093a8e47e962a307a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:48.978707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:48.980353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:49.055777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39412f0c-4e42-4bf9-ab17-c17b7c558942 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:49.083771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad74a5a84650412abfbb212fe4435e2b', 'request_id': 'req-5bb52c6e-720e-487f-ad20-f29ace4febd4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.090415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad74a5a84650412abfbb212fe4435e2b', 'request_id': 'req-5bb52c6e-720e-487f-ad20-f29ace4febd4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.101698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] The token cache is being invalidate because project ad74a5a84650412abfbb212fe4435e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:49.102144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.104108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5bb52c6e-720e-487f-ad20-f29ace4febd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.106045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 999/2002] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:48 2022] DELETE /identity/v3/projects/ad74a5a84650412abfbb212fe4435e2b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:49.111347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9cf5d-daf4-40f8-ab53-383f65514aa9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:49.111665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9cf5d-daf4-40f8-ab53-383f65514aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:49.111961 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9cf5d-daf4-40f8-ab53-383f65514aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:49.115285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:49.118049 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:49.118049 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:49.118049 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] PATH_INFO: `/v3/users/e1e2b5863e804c7a9623828b6baaabe3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:49.118049 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e2b5863e804c7a9623828b6baaabe3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:49.119958 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:49.134114 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e9f9cf5d-daf4-40f8-ab53-383f65514aa9 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:49.135560 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e9f9cf5d-daf4-40f8-ab53-383f65514aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:49.144255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1000/2003] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:49.152196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854ef3a-b228-4bea-aef1-774a8be1ef33 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:49.152513 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854ef3a-b228-4bea-aef1-774a8be1ef33 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:49.152980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854ef3a-b228-4bea-aef1-774a8be1ef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:49.173402 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c854ef3a-b228-4bea-aef1-774a8be1ef33 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:49.174634 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c854ef3a-b228-4bea-aef1-774a8be1ef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:49.187364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1001/2004] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:49.187364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854ef3a-b228-4bea-aef1-774a8be1ef33 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:49.187364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c854ef3a-b228-4bea-aef1-774a8be1ef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:49.198935 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854ef3a-b228-4bea-aef1-774a8be1ef33 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:49.204868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:49.204868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:49.205218 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:49.205466 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] PATH_INFO: `/v3/projects/5ed5a1d8ef8a416c9545cda91c3c905d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:49.206854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed5a1d8ef8a416c9545cda91c3c905d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:49.209935 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:49.320732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e2b5863e804c7a9623828b6baaabe3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.323893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed5a1d8ef8a416c9545cda91c3c905d', 'request_id': 'req-f13c6d4f-b94a-4816-be61-37f4e09edca0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.334398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e2b5863e804c7a9623828b6baaabe3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.335694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e2b5863e804c7a9623828b6baaabe3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.343342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e2b5863e804c7a9623828b6baaabe3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.344037 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e2b5863e804c7a9623828b6baaabe3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.390707 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed5a1d8ef8a416c9545cda91c3c905d', 'request_id': 'req-f13c6d4f-b94a-4816-be61-37f4e09edca0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.398900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed5a1d8ef8a416c9545cda91c3c905d', 'request_id': 'req-f13c6d4f-b94a-4816-be61-37f4e09edca0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.410611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] The token cache is being invalidate because project 5ed5a1d8ef8a416c9545cda91c3c905d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:49.410926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.411582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.413182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1002/2005] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:49 2022] DELETE /identity/v3/projects/5ed5a1d8ef8a416c9545cda91c3c905d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:49.413980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:49.415211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:49.466692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1004/2006] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:48 2022] DELETE /identity/v3/users/e1e2b5863e804c7a9623828b6baaabe3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:49.468472 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:49.470041 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:49.492398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c6d4f-b94a-4816-be61-37f4e09edca0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:49.545136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ccb16-3e90-4260-93f6-75769ba3d81d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:49.551937 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:49.553039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:49.553353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:49.553614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] PATH_INFO: `/v3/users/70f75fc12dc04064a041c96eb577c64f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:49.554854 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f75fc12dc04064a041c96eb577c64f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:49.555283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d0581-ac58-4886-99b5-5e5c04d6695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:49.556209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d0581-ac58-4886-99b5-5e5c04d6695a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:49.556649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d0581-ac58-4886-99b5-5e5c04d6695a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:49.556931 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d0581-ac58-4886-99b5-5e5c04d6695a admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:49.557545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:49.562199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d0581-ac58-4886-99b5-5e5c04d6695a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:49.562199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d0581-ac58-4886-99b5-5e5c04d6695a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:49.562199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d0581-ac58-4886-99b5-5e5c04d6695a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:49.573224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1003/2007] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:49.574285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d0581-ac58-4886-99b5-5e5c04d6695a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:49.578981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-733d0581-ac58-4886-99b5-5e5c04d6695a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:49.591481 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d0581-ac58-4886-99b5-5e5c04d6695a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:49.597244 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:49.598116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:49.598402 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:49.598681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] PATH_INFO: `/v3/users/598b9cd726294e628c77e55495d2dedb` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:49.599908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=598b9cd726294e628c77e55495d2dedb)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:49.601881 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:49.861811 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f75fc12dc04064a041c96eb577c64f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.872999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f75fc12dc04064a041c96eb577c64f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.873739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f75fc12dc04064a041c96eb577c64f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.880345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f75fc12dc04064a041c96eb577c64f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:49.880996 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f75fc12dc04064a041c96eb577c64f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.003934 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598b9cd726294e628c77e55495d2dedb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.022935 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598b9cd726294e628c77e55495d2dedb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.070204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1005/2008] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:49 2022] DELETE /identity/v3/users/70f75fc12dc04064a041c96eb577c64f => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:50.070204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:50.070204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:50.132859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc932ca4-4e91-414f-ad99-3923c2f93990 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:50.137577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19dd4e-d0d6-4f5d-95b5-e729d945b517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:50.138364 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19dd4e-d0d6-4f5d-95b5-e729d945b517 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.138662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19dd4e-d0d6-4f5d-95b5-e729d945b517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.139690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19dd4e-d0d6-4f5d-95b5-e729d945b517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.140291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19dd4e-d0d6-4f5d-95b5-e729d945b517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:50.142223 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19dd4e-d0d6-4f5d-95b5-e729d945b517 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:50.151593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598b9cd726294e628c77e55495d2dedb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.159126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598b9cd726294e628c77e55495d2dedb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.159812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598b9cd726294e628c77e55495d2dedb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.165854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1004/2009] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:49 2022] DELETE /identity/v3/users/598b9cd726294e628c77e55495d2dedb => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:50.166426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:50.167734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:50.232709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607d455-10e7-478a-b440-e720db2d9c6f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:50.237789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:50.238668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.238954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.239258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] PATH_INFO: `/v3/projects/6d9ca1b89e8543658bbd88ac1720c294` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.240468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9ca1b89e8543658bbd88ac1720c294)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:50.242444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:50.273628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1006/2010] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:50 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:50.274924 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef24cf-3e21-4a3b-9f5e-ca4f1940bbdb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.275212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef24cf-3e21-4a3b-9f5e-ca4f1940bbdb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.275493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef24cf-3e21-4a3b-9f5e-ca4f1940bbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.292298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4eef24cf-3e21-4a3b-9f5e-ca4f1940bbdb None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:50.293511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4eef24cf-3e21-4a3b-9f5e-ca4f1940bbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:50.355004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1007/2011] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:50.356243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef24cf-3e21-4a3b-9f5e-ca4f1940bbdb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:50.358345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4eef24cf-3e21-4a3b-9f5e-ca4f1940bbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:50.370809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef24cf-3e21-4a3b-9f5e-ca4f1940bbdb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:50.391450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9ca1b89e8543658bbd88ac1720c294', 'request_id': 'req-56e29d10-7bb9-41e3-8570-678f379fd186'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.430799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34cab7-8ca4-43a5-9dee-e9bc6d3781f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:50.431294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34cab7-8ca4-43a5-9dee-e9bc6d3781f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.431577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34cab7-8ca4-43a5-9dee-e9bc6d3781f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.431850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34cab7-8ca4-43a5-9dee-e9bc6d3781f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.432536 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34cab7-8ca4-43a5-9dee-e9bc6d3781f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:50.434651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34cab7-8ca4-43a5-9dee-e9bc6d3781f3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:50.453747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9ca1b89e8543658bbd88ac1720c294', 'request_id': 'req-56e29d10-7bb9-41e3-8570-678f379fd186'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.460704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9ca1b89e8543658bbd88ac1720c294', 'request_id': 'req-56e29d10-7bb9-41e3-8570-678f379fd186'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.471624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] The token cache is being invalidate because project 6d9ca1b89e8543658bbd88ac1720c294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:50.472000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.472716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56e29d10-7bb9-41e3-8570-678f379fd186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.474404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1005/2012] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:50 2022] DELETE /identity/v3/projects/6d9ca1b89e8543658bbd88ac1720c294 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:50.479834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9caad-baea-4102-ae03-a8560c299d73 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.480136 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9caad-baea-4102-ae03-a8560c299d73 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.480418 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9caad-baea-4102-ae03-a8560c299d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.498795 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c0d9caad-baea-4102-ae03-a8560c299d73 None None] MFA Rules not processed for user `762d950c213a4794aca9afbaa82f2a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:50.500555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c0d9caad-baea-4102-ae03-a8560c299d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:50.554224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1006/2013] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:50.555121 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9caad-baea-4102-ae03-a8560c299d73 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:50.556568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c0d9caad-baea-4102-ae03-a8560c299d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:50.563892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1008/2014] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:50 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:50.567609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bce99d-6f6a-4a00-8a55-9d8de74e39d9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.567609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bce99d-6f6a-4a00-8a55-9d8de74e39d9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.567609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bce99d-6f6a-4a00-8a55-9d8de74e39d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.585441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c1bce99d-6f6a-4a00-8a55-9d8de74e39d9 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:50.586688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c1bce99d-6f6a-4a00-8a55-9d8de74e39d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:50.602108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1009/2015] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:50.603234 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bce99d-6f6a-4a00-8a55-9d8de74e39d9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:50.607149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c1bce99d-6f6a-4a00-8a55-9d8de74e39d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:50.626824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9caad-baea-4102-ae03-a8560c299d73 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:50.630371 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bce99d-6f6a-4a00-8a55-9d8de74e39d9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:50.631401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40131543-7c1e-4cdd-955d-db65b114e146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:50.632254 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131543-7c1e-4cdd-955d-db65b114e146 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.632603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131543-7c1e-4cdd-955d-db65b114e146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.633082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131543-7c1e-4cdd-955d-db65b114e146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.635221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-40131543-7c1e-4cdd-955d-db65b114e146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:50.636321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584497b9-2a68-4e38-a2b6-0ed5c7ee4f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:50.637032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584497b9-2a68-4e38-a2b6-0ed5c7ee4f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.637332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584497b9-2a68-4e38-a2b6-0ed5c7ee4f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.637596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584497b9-2a68-4e38-a2b6-0ed5c7ee4f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.638365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584497b9-2a68-4e38-a2b6-0ed5c7ee4f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:50.640408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584497b9-2a68-4e38-a2b6-0ed5c7ee4f8f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:50.649517 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131543-7c1e-4cdd-955d-db65b114e146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:50.651444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131543-7c1e-4cdd-955d-db65b114e146 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:50.652461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1010/2016] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:50.653780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c0e9-be8a-4502-a205-b1e8197de61d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.654211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c0e9-be8a-4502-a205-b1e8197de61d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.654686 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c0e9-be8a-4502-a205-b1e8197de61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.673961 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1007/2017] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:50.674910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40131543-7c1e-4cdd-955d-db65b114e146 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:50.677043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-40131543-7c1e-4cdd-955d-db65b114e146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:50.677292 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5008c0e9-be8a-4502-a205-b1e8197de61d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:50.678600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5008c0e9-be8a-4502-a205-b1e8197de61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:50.689216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1011/2018] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:50.690506 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c0e9-be8a-4502-a205-b1e8197de61d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:50.690817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40131543-7c1e-4cdd-955d-db65b114e146 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:50.697429 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:50.698492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.698916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.699331 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] PATH_INFO: `/v3/projects/b87c8ce6ed334f449739a73f42a17a4b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.700705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87c8ce6ed334f449739a73f42a17a4b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:50.703223 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:50.703585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c0e9-be8a-4502-a205-b1e8197de61d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:50.708838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683a74b-3dfc-4cbb-abf7-24a8554f4a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:50.709552 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683a74b-3dfc-4cbb-abf7-24a8554f4a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.709838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683a74b-3dfc-4cbb-abf7-24a8554f4a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.710121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683a74b-3dfc-4cbb-abf7-24a8554f4a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.710851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683a74b-3dfc-4cbb-abf7-24a8554f4a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:50.712440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683a74b-3dfc-4cbb-abf7-24a8554f4a79 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:50.727153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1012/2019] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:50.727153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683a74b-3dfc-4cbb-abf7-24a8554f4a79 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:50.738261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683a74b-3dfc-4cbb-abf7-24a8554f4a79 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:50.743045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da85f75-0c3f-486f-9c6e-89c43193f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:50.743902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da85f75-0c3f-486f-9c6e-89c43193f25d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.744241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da85f75-0c3f-486f-9c6e-89c43193f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.748644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da85f75-0c3f-486f-9c6e-89c43193f25d admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.748644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da85f75-0c3f-486f-9c6e-89c43193f25d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:50.748644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da85f75-0c3f-486f-9c6e-89c43193f25d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:50.748644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da85f75-0c3f-486f-9c6e-89c43193f25d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:50.760028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1013/2020] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:50.761040 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da85f75-0c3f-486f-9c6e-89c43193f25d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:50.772189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da85f75-0c3f-486f-9c6e-89c43193f25d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:50.777303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800a09d-e7a0-43e7-87ae-7462171f8540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:50.778277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a09d-e7a0-43e7-87ae-7462171f8540 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:50.790452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a09d-e7a0-43e7-87ae-7462171f8540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:50.790452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a09d-e7a0-43e7-87ae-7462171f8540 admin admin] PATH_INFO: `/v3/projects/92c42d935e984406ba7c2573aacf6cc8/users/0150008332e043fea9936d36ad986da9/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:50.794151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800a09d-e7a0-43e7-87ae-7462171f8540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c42d935e984406ba7c2573aacf6cc8, user_id=0150008332e043fea9936d36ad986da9, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:50.797864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800a09d-e7a0-43e7-87ae-7462171f8540 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:50.914160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1014/2021] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:50 2022] PUT /identity/v3/projects/92c42d935e984406ba7c2573aacf6cc8/users/0150008332e043fea9936d36ad986da9/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:50.915748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800a09d-e7a0-43e7-87ae-7462171f8540 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:50.927094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87c8ce6ed334f449739a73f42a17a4b', 'request_id': 'req-a3be3455-4194-4c92-88e8-ec7382098c29'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:50.986833 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800a09d-e7a0-43e7-87ae-7462171f8540 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:51.007890 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87c8ce6ed334f449739a73f42a17a4b', 'request_id': 'req-a3be3455-4194-4c92-88e8-ec7382098c29'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:51.015445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87c8ce6ed334f449739a73f42a17a4b', 'request_id': 'req-a3be3455-4194-4c92-88e8-ec7382098c29'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:51.026838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] The token cache is being invalidate because project b87c8ce6ed334f449739a73f42a17a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:51.027161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:51.027823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a3be3455-4194-4c92-88e8-ec7382098c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:51.033222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1008/2022] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:50 2022] DELETE /identity/v3/projects/b87c8ce6ed334f449739a73f42a17a4b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:51.033222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444c06-fea4-46e3-8758-1e67b70c47d7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.033222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444c06-fea4-46e3-8758-1e67b70c47d7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.033222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444c06-fea4-46e3-8758-1e67b70c47d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.049985 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1666462-dd91-4e24-b728-2e9525a24252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:51.050951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1666462-dd91-4e24-b728-2e9525a24252 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.051312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1666462-dd91-4e24-b728-2e9525a24252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.051793 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1666462-dd91-4e24-b728-2e9525a24252 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.052588 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1666462-dd91-4e24-b728-2e9525a24252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:51.054614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1666462-dd91-4e24-b728-2e9525a24252 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:51.062785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d4444c06-fea4-46e3-8758-1e67b70c47d7 None None] MFA Rules not processed for user `0150008332e043fea9936d36ad986da9`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:51.064012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d4444c06-fea4-46e3-8758-1e67b70c47d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:51.135871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1009/2023] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:51.140757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c5b5d-281e-4fdd-a19f-c034be6ead85 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.140757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c5b5d-281e-4fdd-a19f-c034be6ead85 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.140757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c5b5d-281e-4fdd-a19f-c034be6ead85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.158541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1015/2024] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:50 2022] POST /identity/v3/projects => generated 371 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:51.160430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d06c5b5d-281e-4fdd-a19f-c034be6ead85 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:51.164561 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d06c5b5d-281e-4fdd-a19f-c034be6ead85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:51.168043 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1666462-dd91-4e24-b728-2e9525a24252 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:51.170497 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b1666462-dd91-4e24-b728-2e9525a24252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:51.236549 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1010/2025] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:51.238247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c5b5d-281e-4fdd-a19f-c034be6ead85 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:51.239723 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d06c5b5d-281e-4fdd-a19f-c034be6ead85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:51.331032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1666462-dd91-4e24-b728-2e9525a24252 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:51.338215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c5b5d-281e-4fdd-a19f-c034be6ead85 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:51.340953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd292cfd-8826-481b-9d46-390ae68ffc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:51.341711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd292cfd-8826-481b-9d46-390ae68ffc13 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.342551 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd292cfd-8826-481b-9d46-390ae68ffc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.342966 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd292cfd-8826-481b-9d46-390ae68ffc13 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.343856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd292cfd-8826-481b-9d46-390ae68ffc13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:51.345819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd292cfd-8826-481b-9d46-390ae68ffc13 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:51.349952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118bec1-81bf-463f-a936-db99e419c576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:51.349952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118bec1-81bf-463f-a936-db99e419c576 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.349952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118bec1-81bf-463f-a936-db99e419c576 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.349952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118bec1-81bf-463f-a936-db99e419c576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.432901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1016/2026] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:51 2022] POST /identity/v3/users => generated 286 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:26:51.435494 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f729a39-4953-419b-bbd4-10d4ff0e1b59 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.435819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f729a39-4953-419b-bbd4-10d4ff0e1b59 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.436147 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f729a39-4953-419b-bbd4-10d4ff0e1b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.440266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118bec1-81bf-463f-a936-db99e419c576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:51.440266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118bec1-81bf-463f-a936-db99e419c576 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:51.449519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1011/2027] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:51.450353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118bec1-81bf-463f-a936-db99e419c576 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:51.461289 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7f729a39-4953-419b-bbd4-10d4ff0e1b59 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:51.461887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118bec1-81bf-463f-a936-db99e419c576 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:51.462485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7f729a39-4953-419b-bbd4-10d4ff0e1b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:51.469921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65246a18-a51c-406c-b4b9-a3e7d8ebb33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:51.477103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65246a18-a51c-406c-b4b9-a3e7d8ebb33e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.477103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65246a18-a51c-406c-b4b9-a3e7d8ebb33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.477103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65246a18-a51c-406c-b4b9-a3e7d8ebb33e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.477692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1017/2028] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:51.477780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65246a18-a51c-406c-b4b9-a3e7d8ebb33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:51.477780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65246a18-a51c-406c-b4b9-a3e7d8ebb33e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:51.477923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f729a39-4953-419b-bbd4-10d4ff0e1b59 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:51.479790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7f729a39-4953-419b-bbd4-10d4ff0e1b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:51.493130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f729a39-4953-419b-bbd4-10d4ff0e1b59 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:51.498742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:51.500081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1012/2029] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:51.500402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.500700 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.501115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] PATH_INFO: `/v3/projects/16dd147917ad4808a54e882c235fba3b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.502489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] RBAC: Authorizing `identity:delete_project(project_id=16dd147917ad4808a54e882c235fba3b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:51.503654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65246a18-a51c-406c-b4b9-a3e7d8ebb33e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:51.504523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:51.526314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65246a18-a51c-406c-b4b9-a3e7d8ebb33e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:51.531829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbb629-b7dc-428a-b1ce-cd95e1a77109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:51.532719 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbb629-b7dc-428a-b1ce-cd95e1a77109 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.533191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbb629-b7dc-428a-b1ce-cd95e1a77109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.533643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbb629-b7dc-428a-b1ce-cd95e1a77109 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.534373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbb629-b7dc-428a-b1ce-cd95e1a77109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:51.534682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbb629-b7dc-428a-b1ce-cd95e1a77109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:51.536493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbb629-b7dc-428a-b1ce-cd95e1a77109 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:51.549611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1013/2030] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:51.550499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbb629-b7dc-428a-b1ce-cd95e1a77109 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:51.561179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbb629-b7dc-428a-b1ce-cd95e1a77109 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:51.566694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4558fb-b9d6-4ac3-b7ce-2351495bcf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:51.567365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4558fb-b9d6-4ac3-b7ce-2351495bcf79 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.567649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4558fb-b9d6-4ac3-b7ce-2351495bcf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.568008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4558fb-b9d6-4ac3-b7ce-2351495bcf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.568767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4558fb-b9d6-4ac3-b7ce-2351495bcf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:51.570424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4558fb-b9d6-4ac3-b7ce-2351495bcf79 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:51.582741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1014/2031] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:51.583590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4558fb-b9d6-4ac3-b7ce-2351495bcf79 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:51.594938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4558fb-b9d6-4ac3-b7ce-2351495bcf79 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:51.600023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9128a-5a0e-4a77-96fc-7b24d7764610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:51.600687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9128a-5a0e-4a77-96fc-7b24d7764610 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.600990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9128a-5a0e-4a77-96fc-7b24d7764610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.601277 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9128a-5a0e-4a77-96fc-7b24d7764610 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.602054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9128a-5a0e-4a77-96fc-7b24d7764610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:51.603991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9128a-5a0e-4a77-96fc-7b24d7764610 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:51.706501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1015/2032] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:51 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:51.706501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9128a-5a0e-4a77-96fc-7b24d7764610 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:51.713949 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16dd147917ad4808a54e882c235fba3b', 'request_id': 'req-e945ce9d-b599-4228-ac23-4fd0cefb050c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:51.764975 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9128a-5a0e-4a77-96fc-7b24d7764610 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:51.771222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89d3a1-bc05-47f3-bed6-c691e09efc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:51.772124 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d3a1-bc05-47f3-bed6-c691e09efc82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.772435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d3a1-bc05-47f3-bed6-c691e09efc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.772708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d3a1-bc05-47f3-bed6-c691e09efc82 admin admin] PATH_INFO: `/v3/projects/cdc03ac8228b476db20b788c9b5384db/users/dec4f72cc7974317a36929f7a2802b66/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.788923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89d3a1-bc05-47f3-bed6-c691e09efc82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc03ac8228b476db20b788c9b5384db, user_id=dec4f72cc7974317a36929f7a2802b66, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:51.791642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89d3a1-bc05-47f3-bed6-c691e09efc82 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:51.798329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16dd147917ad4808a54e882c235fba3b', 'request_id': 'req-e945ce9d-b599-4228-ac23-4fd0cefb050c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:51.804906 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16dd147917ad4808a54e882c235fba3b', 'request_id': 'req-e945ce9d-b599-4228-ac23-4fd0cefb050c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:51.815602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] The token cache is being invalidate because project 16dd147917ad4808a54e882c235fba3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:51.815888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:51.816540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:51.818130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1018/2033] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:51 2022] DELETE /identity/v3/projects/16dd147917ad4808a54e882c235fba3b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:51.818884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:51.820150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:51.882386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945ce9d-b599-4228-ac23-4fd0cefb050c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:51.888662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb17c-1f5f-4180-968e-189c9c608ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:51.888662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb17c-1f5f-4180-968e-189c9c608ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.888662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb17c-1f5f-4180-968e-189c9c608ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.889365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb17c-1f5f-4180-968e-189c9c608ccf admin admin] PATH_INFO: `/v3/users/0150008332e043fea9936d36ad986da9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.891507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deb17c-1f5f-4180-968e-189c9c608ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0150008332e043fea9936d36ad986da9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:51.894789 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deb17c-1f5f-4180-968e-189c9c608ccf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:51.906887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1016/2034] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:51 2022] PUT /identity/v3/projects/cdc03ac8228b476db20b788c9b5384db/users/dec4f72cc7974317a36929f7a2802b66/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:51.907573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89d3a1-bc05-47f3-bed6-c691e09efc82 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:51.909292 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2c89d3a1-bc05-47f3-bed6-c691e09efc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:51.972863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89d3a1-bc05-47f3-bed6-c691e09efc82 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:51.978005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11545bf2-ccf3-46be-b5ae-46938b0aae35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:51.978681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11545bf2-ccf3-46be-b5ae-46938b0aae35 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:51.986810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11545bf2-ccf3-46be-b5ae-46938b0aae35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:51.986810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11545bf2-ccf3-46be-b5ae-46938b0aae35 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:51.986810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11545bf2-ccf3-46be-b5ae-46938b0aae35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:51.986810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11545bf2-ccf3-46be-b5ae-46938b0aae35 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:52.060584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1017/2035] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:51 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:52.062043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11545bf2-ccf3-46be-b5ae-46938b0aae35 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:52.063621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-11545bf2-ccf3-46be-b5ae-46938b0aae35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:52.075370 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11545bf2-ccf3-46be-b5ae-46938b0aae35 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:52.080476 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:52.081378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:52.081640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:52.081918 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] PATH_INFO: `/v3/users/d128e43642d940d4823639c6cdbedd2d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:52.083093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d128e43642d940d4823639c6cdbedd2d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:52.085009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:52.103389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-59deb17c-1f5f-4180-968e-189c9c608ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0150008332e043fea9936d36ad986da9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.117682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-59deb17c-1f5f-4180-968e-189c9c608ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0150008332e043fea9936d36ad986da9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.118373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-59deb17c-1f5f-4180-968e-189c9c608ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0150008332e043fea9936d36ad986da9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.126052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-59deb17c-1f5f-4180-968e-189c9c608ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0150008332e043fea9936d36ad986da9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.126784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-59deb17c-1f5f-4180-968e-189c9c608ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0150008332e043fea9936d36ad986da9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.203196 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1019/2036] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:51 2022] DELETE /identity/v3/users/0150008332e043fea9936d36ad986da9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:52.204661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82320d-b3d4-4e1b-ad39-8b8c3327d55e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:52.204953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82320d-b3d4-4e1b-ad39-8b8c3327d55e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:52.205269 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82320d-b3d4-4e1b-ad39-8b8c3327d55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:52.233855 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3f82320d-b3d4-4e1b-ad39-8b8c3327d55e None None] MFA Rules not processed for user `dec4f72cc7974317a36929f7a2802b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:52.234973 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3f82320d-b3d4-4e1b-ad39-8b8c3327d55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:52.291877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd128e43642d940d4823639c6cdbedd2d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.299314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1020/2037] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:52.300391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82320d-b3d4-4e1b-ad39-8b8c3327d55e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:52.304457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3f82320d-b3d4-4e1b-ad39-8b8c3327d55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:52.305788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd128e43642d940d4823639c6cdbedd2d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.373457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82320d-b3d4-4e1b-ad39-8b8c3327d55e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:52.378493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8fdfe-1876-4bb7-af66-73242db60f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:52.379170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8fdfe-1876-4bb7-af66-73242db60f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:52.379450 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8fdfe-1876-4bb7-af66-73242db60f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:52.379730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8fdfe-1876-4bb7-af66-73242db60f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:52.380499 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8fdfe-1876-4bb7-af66-73242db60f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:52.383999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8fdfe-1876-4bb7-af66-73242db60f08 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:52.391793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd128e43642d940d4823639c6cdbedd2d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.395714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1021/2038] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:52.395714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd68e9-b1a7-45c4-a54d-90c968a526b4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:52.395714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd68e9-b1a7-45c4-a54d-90c968a526b4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:52.395714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd68e9-b1a7-45c4-a54d-90c968a526b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:52.403422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd128e43642d940d4823639c6cdbedd2d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.404122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd128e43642d940d4823639c6cdbedd2d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.415176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1018/2039] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:52 2022] DELETE /identity/v3/users/d128e43642d940d4823639c6cdbedd2d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:52.415176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:52.415176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:52.415863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4dcd68e9-b1a7-45c4-a54d-90c968a526b4 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:52.415863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4dcd68e9-b1a7-45c4-a54d-90c968a526b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:52.494384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1022/2040] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:52.494384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd68e9-b1a7-45c4-a54d-90c968a526b4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:52.495725 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4dcd68e9-b1a7-45c4-a54d-90c968a526b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:52.507573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac2848-db18-451d-93a1-11a3254113fa admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:52.511691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02740ec-ef23-4f0a-adc1-08e6a3e0b532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:52.512385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02740ec-ef23-4f0a-adc1-08e6a3e0b532 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:52.512669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02740ec-ef23-4f0a-adc1-08e6a3e0b532 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:52.512780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd68e9-b1a7-45c4-a54d-90c968a526b4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:52.512945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02740ec-ef23-4f0a-adc1-08e6a3e0b532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:52.515943 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b02740ec-ef23-4f0a-adc1-08e6a3e0b532 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:52.535107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68650f3b-89d1-42a3-8a7a-90d6c953c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:52.535835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68650f3b-89d1-42a3-8a7a-90d6c953c0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:52.536134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68650f3b-89d1-42a3-8a7a-90d6c953c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:52.536390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68650f3b-89d1-42a3-8a7a-90d6c953c0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:52.537235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68650f3b-89d1-42a3-8a7a-90d6c953c0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:52.538894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68650f3b-89d1-42a3-8a7a-90d6c953c0e3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:52.566272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1023/2041] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:52.567265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68650f3b-89d1-42a3-8a7a-90d6c953c0e3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:52.570418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-68650f3b-89d1-42a3-8a7a-90d6c953c0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:52.600070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02740ec-ef23-4f0a-adc1-08e6a3e0b532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:52.601596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02740ec-ef23-4f0a-adc1-08e6a3e0b532 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:52.611373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1019/2042] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:52.612235 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02740ec-ef23-4f0a-adc1-08e6a3e0b532 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:52.630715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02740ec-ef23-4f0a-adc1-08e6a3e0b532 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:52.630715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a567378-a5ed-488f-9cd4-086606cb86e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:52.637437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68650f3b-89d1-42a3-8a7a-90d6c953c0e3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:52.637571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567378-a5ed-488f-9cd4-086606cb86e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:52.637571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567378-a5ed-488f-9cd4-086606cb86e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:52.637571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567378-a5ed-488f-9cd4-086606cb86e7 admin admin] PATH_INFO: `/v3/projects/46f77bd017ea4c07966cdf7c6d14ef99/users/44769305fbc34e73bd4e9b1ca69f8cd6/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:52.637799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba3593-7965-4747-b9b3-5edf91f81442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:52.637799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3593-7965-4747-b9b3-5edf91f81442 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:52.637799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3593-7965-4747-b9b3-5edf91f81442 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:52.637799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3593-7965-4747-b9b3-5edf91f81442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:52.647633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba3593-7965-4747-b9b3-5edf91f81442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:52.649160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba3593-7965-4747-b9b3-5edf91f81442 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:52.649708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a567378-a5ed-488f-9cd4-086606cb86e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f77bd017ea4c07966cdf7c6d14ef99, user_id=44769305fbc34e73bd4e9b1ca69f8cd6, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:52.652485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a567378-a5ed-488f-9cd4-086606cb86e7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:52.659403 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1024/2043] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:52.660266 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba3593-7965-4747-b9b3-5edf91f81442 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:52.662100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3fba3593-7965-4747-b9b3-5edf91f81442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:52.675278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba3593-7965-4747-b9b3-5edf91f81442 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:52.680633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dae18-d282-4e3e-ac78-8279d00ddfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:52.681601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dae18-d282-4e3e-ac78-8279d00ddfc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:52.681902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dae18-d282-4e3e-ac78-8279d00ddfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:52.682184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dae18-d282-4e3e-ac78-8279d00ddfc8 admin admin] PATH_INFO: `/v3/users/dec4f72cc7974317a36929f7a2802b66` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:52.683405 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76dae18-d282-4e3e-ac78-8279d00ddfc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec4f72cc7974317a36929f7a2802b66)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:52.685732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76dae18-d282-4e3e-ac78-8279d00ddfc8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:52.825696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1020/2044] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:52 2022] PUT /identity/v3/projects/46f77bd017ea4c07966cdf7c6d14ef99/users/44769305fbc34e73bd4e9b1ca69f8cd6/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:52.837677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ce81-80c7-4436-a883-36b39c89f57a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:52.837970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ce81-80c7-4436-a883-36b39c89f57a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:52.838249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ce81-80c7-4436-a883-36b39c89f57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:52.869655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1664ce81-80c7-4436-a883-36b39c89f57a None None] MFA Rules not processed for user `44769305fbc34e73bd4e9b1ca69f8cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:52.871295 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1664ce81-80c7-4436-a883-36b39c89f57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:52.917922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a76dae18-d282-4e3e-ac78-8279d00ddfc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec4f72cc7974317a36929f7a2802b66'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.931650 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a76dae18-d282-4e3e-ac78-8279d00ddfc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec4f72cc7974317a36929f7a2802b66'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.932442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a76dae18-d282-4e3e-ac78-8279d00ddfc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec4f72cc7974317a36929f7a2802b66'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.940908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a76dae18-d282-4e3e-ac78-8279d00ddfc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec4f72cc7974317a36929f7a2802b66'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.941885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a76dae18-d282-4e3e-ac78-8279d00ddfc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec4f72cc7974317a36929f7a2802b66'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:52.948701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1021/2045] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:52.949770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ce81-80c7-4436-a883-36b39c89f57a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:53.019360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ce81-80c7-4436-a883-36b39c89f57a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:53.023005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf2815-f309-446f-ac4e-2bc18ab10ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:53.024027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2815-f309-446f-ac4e-2bc18ab10ada admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.024481 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2815-f309-446f-ac4e-2bc18ab10ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.024926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2815-f309-446f-ac4e-2bc18ab10ada admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.025885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf2815-f309-446f-ac4e-2bc18ab10ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:53.028286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf2815-f309-446f-ac4e-2bc18ab10ada admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:53.032467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1025/2046] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:52 2022] DELETE /identity/v3/users/dec4f72cc7974317a36929f7a2802b66 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:53.034324 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd58f8-c86f-42a7-a58e-145446c6ae00 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.034740 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd58f8-c86f-42a7-a58e-145446c6ae00 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.036280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd58f8-c86f-42a7-a58e-145446c6ae00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.061908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cefd58f8-c86f-42a7-a58e-145446c6ae00 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:53.063537 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cefd58f8-c86f-42a7-a58e-145446c6ae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:53.124824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1026/2047] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:53.125709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd58f8-c86f-42a7-a58e-145446c6ae00 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:53.127081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cefd58f8-c86f-42a7-a58e-145446c6ae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:53.141704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd58f8-c86f-42a7-a58e-145446c6ae00 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:53.146873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:53.147661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.147980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.148249 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] PATH_INFO: `/v3/projects/0fd5e04e43a748fa8d43b7d405862198` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.149616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd5e04e43a748fa8d43b7d405862198)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:53.151537 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:53.154188 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1022/2048] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:52 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:53.155314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf2815-f309-446f-ac4e-2bc18ab10ada admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:53.161212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ebaf2815-f309-446f-ac4e-2bc18ab10ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:53.229585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf2815-f309-446f-ac4e-2bc18ab10ada admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:53.234352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada3cd-528c-4a74-91d8-42d4ee3eae98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:53.235084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada3cd-528c-4a74-91d8-42d4ee3eae98 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.235365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada3cd-528c-4a74-91d8-42d4ee3eae98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.235641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada3cd-528c-4a74-91d8-42d4ee3eae98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.255995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd5e04e43a748fa8d43b7d405862198', 'request_id': 'req-2a9ef6af-4b35-48ad-9214-169a41b03a28'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:53.297072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ada3cd-528c-4a74-91d8-42d4ee3eae98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:53.298606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ada3cd-528c-4a74-91d8-42d4ee3eae98 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:53.308495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1023/2049] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:53.309334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada3cd-528c-4a74-91d8-42d4ee3eae98 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:53.311165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e7ada3cd-528c-4a74-91d8-42d4ee3eae98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:53.323470 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada3cd-528c-4a74-91d8-42d4ee3eae98 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:53.351990 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd5e04e43a748fa8d43b7d405862198', 'request_id': 'req-2a9ef6af-4b35-48ad-9214-169a41b03a28'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:53.359356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd5e04e43a748fa8d43b7d405862198', 'request_id': 'req-2a9ef6af-4b35-48ad-9214-169a41b03a28'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:53.370351 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] The token cache is being invalidate because project 0fd5e04e43a748fa8d43b7d405862198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:53.370644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:53.371406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:53.373033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1027/2050] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:53 2022] DELETE /identity/v3/projects/0fd5e04e43a748fa8d43b7d405862198 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:53.377287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:53.377287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:53.385820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:53.388046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.388046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.388046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] PATH_INFO: `/v3/projects/92c42d935e984406ba7c2573aacf6cc8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.388495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c42d935e984406ba7c2573aacf6cc8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:53.390659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:53.439267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ef6af-4b35-48ad-9214-169a41b03a28 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:53.444133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946be76-e1b4-4d7b-974e-e16398a9a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:53.444788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946be76-e1b4-4d7b-974e-e16398a9a0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.445103 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946be76-e1b4-4d7b-974e-e16398a9a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.445374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946be76-e1b4-4d7b-974e-e16398a9a0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.446071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946be76-e1b4-4d7b-974e-e16398a9a0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:53.448012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946be76-e1b4-4d7b-974e-e16398a9a0c3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:53.518036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c42d935e984406ba7c2573aacf6cc8', 'request_id': 'req-eaaf70da-79b0-4cc4-9c2a-76974067203b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:53.530902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1028/2051] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:53 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:53.533596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1839edc-7729-48ae-a34b-903563dcbda2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.536613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1839edc-7729-48ae-a34b-903563dcbda2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.536613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1839edc-7729-48ae-a34b-903563dcbda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.553410 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e1839edc-7729-48ae-a34b-903563dcbda2 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:53.554656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e1839edc-7729-48ae-a34b-903563dcbda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:53.626411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c42d935e984406ba7c2573aacf6cc8', 'request_id': 'req-eaaf70da-79b0-4cc4-9c2a-76974067203b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:53.634153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c42d935e984406ba7c2573aacf6cc8', 'request_id': 'req-eaaf70da-79b0-4cc4-9c2a-76974067203b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:53.647441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] The token cache is being invalidate because project 92c42d935e984406ba7c2573aacf6cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:53.647830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:53.648537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eaaf70da-79b0-4cc4-9c2a-76974067203b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:53.649938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1029/2052] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:53.651275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1839edc-7729-48ae-a34b-903563dcbda2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:53.658293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1024/2053] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:53 2022] DELETE /identity/v3/projects/92c42d935e984406ba7c2573aacf6cc8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:53.661233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b317b04-9371-44e2-938d-bedf6b21b94f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.661233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b317b04-9371-44e2-938d-bedf6b21b94f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.661233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b317b04-9371-44e2-938d-bedf6b21b94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.680364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6b317b04-9371-44e2-938d-bedf6b21b94f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:53.681743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6b317b04-9371-44e2-938d-bedf6b21b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:53.687474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1839edc-7729-48ae-a34b-903563dcbda2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:53.700868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1025/2054] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:53.703020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1adeca-d9d4-4fb8-8ea0-ea3b8a5e89cd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.703479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1adeca-d9d4-4fb8-8ea0-ea3b8a5e89cd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.703767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1adeca-d9d4-4fb8-8ea0-ea3b8a5e89cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.706034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc77a-2c5b-4c2d-bbd7-0fe6dcf1aabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:53.706714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc77a-2c5b-4c2d-bbd7-0fe6dcf1aabc admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.706995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc77a-2c5b-4c2d-bbd7-0fe6dcf1aabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.707293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc77a-2c5b-4c2d-bbd7-0fe6dcf1aabc admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.708026 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc77a-2c5b-4c2d-bbd7-0fe6dcf1aabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:53.709900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc77a-2c5b-4c2d-bbd7-0fe6dcf1aabc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:53.721580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1030/2055] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:53.722634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc77a-2c5b-4c2d-bbd7-0fe6dcf1aabc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:53.727354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7c1adeca-d9d4-4fb8-8ea0-ea3b8a5e89cd None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:53.728811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7c1adeca-d9d4-4fb8-8ea0-ea3b8a5e89cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:53.734071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc77a-2c5b-4c2d-bbd7-0fe6dcf1aabc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:53.738507 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1026/2056] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:53.738787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a6761-57d8-4930-a190-f606adf9142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:53.750842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1adeca-d9d4-4fb8-8ea0-ea3b8a5e89cd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:53.750978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a6761-57d8-4930-a190-f606adf9142b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.750978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a6761-57d8-4930-a190-f606adf9142b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.750978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a6761-57d8-4930-a190-f606adf9142b admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.751226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7c1adeca-d9d4-4fb8-8ea0-ea3b8a5e89cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:53.751320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a6761-57d8-4930-a190-f606adf9142b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:53.751320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a6761-57d8-4930-a190-f606adf9142b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:53.751320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a6761-57d8-4930-a190-f606adf9142b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:53.757621 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1031/2057] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:53.758176 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a6761-57d8-4930-a190-f606adf9142b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:53.760494 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7e8a6761-57d8-4930-a190-f606adf9142b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:53.768013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1adeca-d9d4-4fb8-8ea0-ea3b8a5e89cd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:53.773358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ea135-0692-4e1f-809e-91004918cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:53.774257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea135-0692-4e1f-809e-91004918cbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.774548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea135-0692-4e1f-809e-91004918cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.774812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ea135-0692-4e1f-809e-91004918cbf8 admin admin] PATH_INFO: `/v3/projects/45e033a342f545aaaaac4663e28cbaf3/users/2333b1a17ab9417c88c7a888dbc3da84/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.781290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a6761-57d8-4930-a190-f606adf9142b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:53.793049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ea135-0692-4e1f-809e-91004918cbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e033a342f545aaaaac4663e28cbaf3, user_id=2333b1a17ab9417c88c7a888dbc3da84, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:53.794435 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:53.795470 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.795745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.796017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] PATH_INFO: `/v3/projects/cdc03ac8228b476db20b788c9b5384db` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.797071 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ea135-0692-4e1f-809e-91004918cbf8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:53.797349 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc03ac8228b476db20b788c9b5384db)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:53.802770 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:53.866995 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1027/2058] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:53 2022] PUT /identity/v3/projects/45e033a342f545aaaaac4663e28cbaf3/users/2333b1a17ab9417c88c7a888dbc3da84/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:53.868299 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d2dc-4c22-485b-9762-61094fba653f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:53.868593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d2dc-4c22-485b-9762-61094fba653f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:53.868874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d2dc-4c22-485b-9762-61094fba653f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:53.886988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5eb8d2dc-4c22-485b-9762-61094fba653f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:53.888340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5eb8d2dc-4c22-485b-9762-61094fba653f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:53.961094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1028/2059] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:53.961829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8d2dc-4c22-485b-9762-61094fba653f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:53.973336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8d2dc-4c22-485b-9762-61094fba653f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:53.977011 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc03ac8228b476db20b788c9b5384db', 'request_id': 'req-9eb50c23-3a07-4242-bdf5-9470381ce5dc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:54.032882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331cf07-9316-4e8e-8e1a-8d9848231159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.033590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331cf07-9316-4e8e-8e1a-8d9848231159 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.033876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331cf07-9316-4e8e-8e1a-8d9848231159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.034162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331cf07-9316-4e8e-8e1a-8d9848231159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.034988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331cf07-9316-4e8e-8e1a-8d9848231159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.036987 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331cf07-9316-4e8e-8e1a-8d9848231159 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.077942 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc03ac8228b476db20b788c9b5384db', 'request_id': 'req-9eb50c23-3a07-4242-bdf5-9470381ce5dc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:54.084655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc03ac8228b476db20b788c9b5384db', 'request_id': 'req-9eb50c23-3a07-4242-bdf5-9470381ce5dc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:54.095526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] The token cache is being invalidate because project cdc03ac8228b476db20b788c9b5384db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:26:54.095856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:54.096558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:54.098538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1032/2060] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:26:53 2022] DELETE /identity/v3/projects/cdc03ac8228b476db20b788c9b5384db => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:54.103217 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.104766 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:54.118780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50c23-3a07-4242-bdf5-9470381ce5dc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.124639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695aef6-0e6c-4382-8627-30d6f8b5c718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.125418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695aef6-0e6c-4382-8627-30d6f8b5c718 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.125975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695aef6-0e6c-4382-8627-30d6f8b5c718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.125975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695aef6-0e6c-4382-8627-30d6f8b5c718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.126701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695aef6-0e6c-4382-8627-30d6f8b5c718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.128489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695aef6-0e6c-4382-8627-30d6f8b5c718 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.143229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1033/2061] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:54.143229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695aef6-0e6c-4382-8627-30d6f8b5c718 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.143609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9695aef6-0e6c-4382-8627-30d6f8b5c718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:54.152759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1029/2062] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:53 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:54.154353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a189be-43b7-4703-abd6-98b3cf7077dd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.155077 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a189be-43b7-4703-abd6-98b3cf7077dd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.155397 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a189be-43b7-4703-abd6-98b3cf7077dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.158300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695aef6-0e6c-4382-8627-30d6f8b5c718 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.176234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f4a189be-43b7-4703-abd6-98b3cf7077dd None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:54.177756 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f4a189be-43b7-4703-abd6-98b3cf7077dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:54.220783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3664a15-767e-4c54-8196-9c4f1b305f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.221607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664a15-767e-4c54-8196-9c4f1b305f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.221974 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664a15-767e-4c54-8196-9c4f1b305f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.222253 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664a15-767e-4c54-8196-9c4f1b305f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.222991 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664a15-767e-4c54-8196-9c4f1b305f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:54.223289 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664a15-767e-4c54-8196-9c4f1b305f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.224917 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664a15-767e-4c54-8196-9c4f1b305f31 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.241260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1034/2063] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:54.241260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3664a15-767e-4c54-8196-9c4f1b305f31 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.255491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1030/2064] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:54.255491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a189be-43b7-4703-abd6-98b3cf7077dd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.255666 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3664a15-767e-4c54-8196-9c4f1b305f31 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.255773 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f4a189be-43b7-4703-abd6-98b3cf7077dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:54.255865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3590ef-ed44-47e9-b07f-0f81903baed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.255865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3590ef-ed44-47e9-b07f-0f81903baed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.256039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3590ef-ed44-47e9-b07f-0f81903baed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.256310 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3590ef-ed44-47e9-b07f-0f81903baed0 admin admin] PATH_INFO: `/v3/projects/45e033a342f545aaaaac4663e28cbaf3/users/2333b1a17ab9417c88c7a888dbc3da84/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.258907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3590ef-ed44-47e9-b07f-0f81903baed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e033a342f545aaaaac4663e28cbaf3, user_id=2333b1a17ab9417c88c7a888dbc3da84, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.261953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3590ef-ed44-47e9-b07f-0f81903baed0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.271032 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a189be-43b7-4703-abd6-98b3cf7077dd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.275354 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1035/2065] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:54 2022] PUT /identity/v3/projects/45e033a342f545aaaaac4663e28cbaf3/users/2333b1a17ab9417c88c7a888dbc3da84/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:54.276017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3590ef-ed44-47e9-b07f-0f81903baed0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.334228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261663f-9f28-45bb-9343-59a3fd4ae218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.334873 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261663f-9f28-45bb-9343-59a3fd4ae218 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.335219 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261663f-9f28-45bb-9343-59a3fd4ae218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.335587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261663f-9f28-45bb-9343-59a3fd4ae218 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.336353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261663f-9f28-45bb-9343-59a3fd4ae218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.338576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261663f-9f28-45bb-9343-59a3fd4ae218 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.358398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3590ef-ed44-47e9-b07f-0f81903baed0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.363479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82d572-d6b9-4653-8bc1-c5d802377dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.364143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82d572-d6b9-4653-8bc1-c5d802377dbc admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.364427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82d572-d6b9-4653-8bc1-c5d802377dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.364703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82d572-d6b9-4653-8bc1-c5d802377dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.365440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82d572-d6b9-4653-8bc1-c5d802377dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.367337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82d572-d6b9-4653-8bc1-c5d802377dbc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.426710 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1031/2066] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:54 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:54.428307 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f0c9a-7c05-413b-9285-221184b711da None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.428599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f0c9a-7c05-413b-9285-221184b711da None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.428901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f0c9a-7c05-413b-9285-221184b711da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.446975 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-234f0c9a-7c05-413b-9285-221184b711da None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:54.448181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-234f0c9a-7c05-413b-9285-221184b711da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:54.456573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1032/2067] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:54.457903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd88fb-76b8-4888-9b38-6a07cf2374b5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.458185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd88fb-76b8-4888-9b38-6a07cf2374b5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.458459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd88fb-76b8-4888-9b38-6a07cf2374b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.464662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1036/2068] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:54 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:54.469391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82d572-d6b9-4653-8bc1-c5d802377dbc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.489104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fffd88fb-76b8-4888-9b38-6a07cf2374b5 None None] MFA Rules not processed for user `2333b1a17ab9417c88c7a888dbc3da84`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:54.490445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fffd88fb-76b8-4888-9b38-6a07cf2374b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:54.537696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82d572-d6b9-4653-8bc1-c5d802377dbc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.543108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a4f35-780b-467e-ac9c-b669630997bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.547570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4f35-780b-467e-ac9c-b669630997bf admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.547570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4f35-780b-467e-ac9c-b669630997bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.547570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4f35-780b-467e-ac9c-b669630997bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.547570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a4f35-780b-467e-ac9c-b669630997bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.547570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a4f35-780b-467e-ac9c-b669630997bf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.557972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1037/2069] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:54.558891 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a4f35-780b-467e-ac9c-b669630997bf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.569292 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a4f35-780b-467e-ac9c-b669630997bf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.575172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59fb9f-34ca-4679-9858-dcdca3c3c991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.576538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59fb9f-34ca-4679-9858-dcdca3c3c991 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.576538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59fb9f-34ca-4679-9858-dcdca3c3c991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.576538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59fb9f-34ca-4679-9858-dcdca3c3c991 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.577193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59fb9f-34ca-4679-9858-dcdca3c3c991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:26:54.577523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59fb9f-34ca-4679-9858-dcdca3c3c991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.579146 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1033/2070] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:54.579601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59fb9f-34ca-4679-9858-dcdca3c3c991 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.580001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd88fb-76b8-4888-9b38-6a07cf2374b5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.591216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd88fb-76b8-4888-9b38-6a07cf2374b5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.594776 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1038/2071] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:26:54.595835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59fb9f-34ca-4679-9858-dcdca3c3c991 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.600602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02581e09-ae50-4fd1-b73e-e1f5103ec4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.601564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02581e09-ae50-4fd1-b73e-e1f5103ec4cd admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.601676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02581e09-ae50-4fd1-b73e-e1f5103ec4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.601902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02581e09-ae50-4fd1-b73e-e1f5103ec4cd admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.602603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02581e09-ae50-4fd1-b73e-e1f5103ec4cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.604741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02581e09-ae50-4fd1-b73e-e1f5103ec4cd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.608517 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59fb9f-34ca-4679-9858-dcdca3c3c991 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.614452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269302c-838d-4e7a-a360-9cae33d50343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.615299 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269302c-838d-4e7a-a360-9cae33d50343 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.615581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269302c-838d-4e7a-a360-9cae33d50343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.615867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269302c-838d-4e7a-a360-9cae33d50343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.616601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269302c-838d-4e7a-a360-9cae33d50343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.618364 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269302c-838d-4e7a-a360-9cae33d50343 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.632243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1039/2072] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:54.632243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269302c-838d-4e7a-a360-9cae33d50343 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.632243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e269302c-838d-4e7a-a360-9cae33d50343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:54.691491 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269302c-838d-4e7a-a360-9cae33d50343 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.695592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611ca3-72f3-49a5-8b3b-5655a59356de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.696046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1034/2073] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:54 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:54.696623 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611ca3-72f3-49a5-8b3b-5655a59356de service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.697009 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02581e09-ae50-4fd1-b73e-e1f5103ec4cd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.697508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611ca3-72f3-49a5-8b3b-5655a59356de service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.697956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611ca3-72f3-49a5-8b3b-5655a59356de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.708554 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93611ca3-72f3-49a5-8b3b-5655a59356de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.710511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93611ca3-72f3-49a5-8b3b-5655a59356de service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.710821 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02581e09-ae50-4fd1-b73e-e1f5103ec4cd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.716776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2daa5c-7b27-4eda-9407-e5cca09450b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.717616 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2daa5c-7b27-4eda-9407-e5cca09450b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.717840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2daa5c-7b27-4eda-9407-e5cca09450b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.718114 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2daa5c-7b27-4eda-9407-e5cca09450b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.718996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2daa5c-7b27-4eda-9407-e5cca09450b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.721160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2daa5c-7b27-4eda-9407-e5cca09450b5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.723056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1040/2074] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:54.724100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611ca3-72f3-49a5-8b3b-5655a59356de service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.735856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611ca3-72f3-49a5-8b3b-5655a59356de service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.741264 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0245d45-552a-422d-b1cc-0df3aab1f366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.742501 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0245d45-552a-422d-b1cc-0df3aab1f366 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.742967 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0245d45-552a-422d-b1cc-0df3aab1f366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.743297 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0245d45-552a-422d-b1cc-0df3aab1f366 admin admin] PATH_INFO: `/v3/projects/62b35280331c474cab91f78c592ef962/users/27503be37e454494ab8a4bb96cf630b0/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.761085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0245d45-552a-422d-b1cc-0df3aab1f366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b35280331c474cab91f78c592ef962, user_id=27503be37e454494ab8a4bb96cf630b0, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.763830 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0245d45-552a-422d-b1cc-0df3aab1f366 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.823812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1035/2075] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:54 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:54.823812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2daa5c-7b27-4eda-9407-e5cca09450b5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.855782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1041/2076] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:54 2022] PUT /identity/v3/projects/62b35280331c474cab91f78c592ef962/users/27503be37e454494ab8a4bb96cf630b0/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:54.856587 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0245d45-552a-422d-b1cc-0df3aab1f366 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:54.922161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2daa5c-7b27-4eda-9407-e5cca09450b5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.922611 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0245d45-552a-422d-b1cc-0df3aab1f366 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:54.927643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0958ac1-eebf-457a-94ba-eaf8a56fa0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.928409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0958ac1-eebf-457a-94ba-eaf8a56fa0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.928689 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0958ac1-eebf-457a-94ba-eaf8a56fa0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.928983 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0958ac1-eebf-457a-94ba-eaf8a56fa0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.930086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0958ac1-eebf-457a-94ba-eaf8a56fa0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.930868 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d6f26-5a4e-4ba5-9506-34b4feaebd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:54.931615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0958ac1-eebf-457a-94ba-eaf8a56fa0f3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.932053 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6f26-5a4e-4ba5-9506-34b4feaebd89 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.933173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6f26-5a4e-4ba5-9506-34b4feaebd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.933607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6f26-5a4e-4ba5-9506-34b4feaebd89 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.934562 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d6f26-5a4e-4ba5-9506-34b4feaebd89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:54.937693 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d6f26-5a4e-4ba5-9506-34b4feaebd89 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:54.948752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1036/2077] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:54.956449 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5f29-eab2-4860-bbd2-6e67d424f922 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:54.956803 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5f29-eab2-4860-bbd2-6e67d424f922 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:54.957131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5f29-eab2-4860-bbd2-6e67d424f922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:54.986373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-627d5f29-eab2-4860-bbd2-6e67d424f922 None None] MFA Rules not processed for user `27503be37e454494ab8a4bb96cf630b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:54.988161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-627d5f29-eab2-4860-bbd2-6e67d424f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:55.037853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1042/2078] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:54 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:55.037853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d6f26-5a4e-4ba5-9506-34b4feaebd89 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.054549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d6f26-5a4e-4ba5-9506-34b4feaebd89 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.059866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456550fb-02f6-41aa-8d30-26d357643273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.060772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456550fb-02f6-41aa-8d30-26d357643273 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.061230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456550fb-02f6-41aa-8d30-26d357643273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.062082 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456550fb-02f6-41aa-8d30-26d357643273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.062548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456550fb-02f6-41aa-8d30-26d357643273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.064323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456550fb-02f6-41aa-8d30-26d357643273 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:55.076823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1043/2079] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:55.077792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456550fb-02f6-41aa-8d30-26d357643273 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.084288 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1037/2080] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:55.093588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d5f29-eab2-4860-bbd2-6e67d424f922 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.093756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456550fb-02f6-41aa-8d30-26d357643273 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.093756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86981b-bacd-4416-80d2-cd0ed3687da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.094093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86981b-bacd-4416-80d2-cd0ed3687da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.094382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86981b-bacd-4416-80d2-cd0ed3687da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.094667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86981b-bacd-4416-80d2-cd0ed3687da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.095422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86981b-bacd-4416-80d2-cd0ed3687da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.097055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86981b-bacd-4416-80d2-cd0ed3687da1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:55.107838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1044/2081] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:55.108769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86981b-bacd-4416-80d2-cd0ed3687da1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.119281 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86981b-bacd-4416-80d2-cd0ed3687da1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.124752 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d507b-8b37-41dc-a153-2e3a18c2e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.126236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d507b-8b37-41dc-a153-2e3a18c2e64e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.126823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d507b-8b37-41dc-a153-2e3a18c2e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.126823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d507b-8b37-41dc-a153-2e3a18c2e64e admin admin] PATH_INFO: `/v3/projects/32b7769b89c24062a0adb9089b550775/users/5599531908394fa5ba8bfe1588f294bd/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.145412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d507b-8b37-41dc-a153-2e3a18c2e64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b7769b89c24062a0adb9089b550775, user_id=5599531908394fa5ba8bfe1588f294bd, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.148324 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d507b-8b37-41dc-a153-2e3a18c2e64e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:55.154508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d5f29-eab2-4860-bbd2-6e67d424f922 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.159969 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a841c3-3831-44ea-8bfd-1d5d20f2dd24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.162391 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a841c3-3831-44ea-8bfd-1d5d20f2dd24 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.162391 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a841c3-3831-44ea-8bfd-1d5d20f2dd24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.162391 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a841c3-3831-44ea-8bfd-1d5d20f2dd24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.163338 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-66a841c3-3831-44ea-8bfd-1d5d20f2dd24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:55.229905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a841c3-3831-44ea-8bfd-1d5d20f2dd24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.231582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a841c3-3831-44ea-8bfd-1d5d20f2dd24 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:55.238267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1045/2082] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:55 2022] PUT /identity/v3/projects/32b7769b89c24062a0adb9089b550775/users/5599531908394fa5ba8bfe1588f294bd/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:55.239166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d507b-8b37-41dc-a153-2e3a18c2e64e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.252416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1038/2083] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:55.254018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a841c3-3831-44ea-8bfd-1d5d20f2dd24 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.272183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a841c3-3831-44ea-8bfd-1d5d20f2dd24 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.313397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d507b-8b37-41dc-a153-2e3a18c2e64e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.319462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b38d50-3b22-4dc7-9dc2-b6a7958c96bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.321111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38d50-3b22-4dc7-9dc2-b6a7958c96bc admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.321417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38d50-3b22-4dc7-9dc2-b6a7958c96bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.321836 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38d50-3b22-4dc7-9dc2-b6a7958c96bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.322686 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b38d50-3b22-4dc7-9dc2-b6a7958c96bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.324787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b38d50-3b22-4dc7-9dc2-b6a7958c96bc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:55.370778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575093a-8c86-4a46-910c-1d089a358a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.374956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575093a-8c86-4a46-910c-1d089a358a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.374956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575093a-8c86-4a46-910c-1d089a358a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.374956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575093a-8c86-4a46-910c-1d089a358a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.374956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575093a-8c86-4a46-910c-1d089a358a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.374956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575093a-8c86-4a46-910c-1d089a358a4c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:55.399162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1039/2084] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:55.400996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056ab5b-f800-415b-9968-edfc51456ca9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.400996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056ab5b-f800-415b-9968-edfc51456ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.401261 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056ab5b-f800-415b-9968-edfc51456ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.431521 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0056ab5b-f800-415b-9968-edfc51456ca9 None None] MFA Rules not processed for user `5599531908394fa5ba8bfe1588f294bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:55.432712 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0056ab5b-f800-415b-9968-edfc51456ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:55.441127 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1046/2085] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:55 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:55.441322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b38d50-3b22-4dc7-9dc2-b6a7958c96bc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.505199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1040/2086] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:55.506030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056ab5b-f800-415b-9968-edfc51456ca9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.516390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056ab5b-f800-415b-9968-edfc51456ca9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.521137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbfe54-237d-4644-8993-1dadfd17494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.521810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbfe54-237d-4644-8993-1dadfd17494b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.522095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbfe54-237d-4644-8993-1dadfd17494b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.522368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbfe54-237d-4644-8993-1dadfd17494b admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.523060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbfe54-237d-4644-8993-1dadfd17494b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.523849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b38d50-3b22-4dc7-9dc2-b6a7958c96bc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.525044 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbfe54-237d-4644-8993-1dadfd17494b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:55.528726 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb6a24-0f95-4e28-ab41-6c06c1fbc700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.530195 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb6a24-0f95-4e28-ab41-6c06c1fbc700 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.530655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb6a24-0f95-4e28-ab41-6c06c1fbc700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.530990 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb6a24-0f95-4e28-ab41-6c06c1fbc700 admin admin] PATH_INFO: `/v3/projects/acc6a560caaf472aa26af3f89cdb833c/users/3442c1e1c9214ed69ae4211fcb7d7c15/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.546432 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb6a24-0f95-4e28-ab41-6c06c1fbc700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc6a560caaf472aa26af3f89cdb833c, user_id=3442c1e1c9214ed69ae4211fcb7d7c15, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.549267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb6a24-0f95-4e28-ab41-6c06c1fbc700 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:55.627506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1041/2087] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:55 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:55.628468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbfe54-237d-4644-8993-1dadfd17494b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.638494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbfe54-237d-4644-8993-1dadfd17494b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.643738 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a168ca0-21ba-41c9-97b8-d6c5a56a3440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.644368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168ca0-21ba-41c9-97b8-d6c5a56a3440 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.644644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168ca0-21ba-41c9-97b8-d6c5a56a3440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.644915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168ca0-21ba-41c9-97b8-d6c5a56a3440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.645625 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a168ca0-21ba-41c9-97b8-d6c5a56a3440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.647496 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a168ca0-21ba-41c9-97b8-d6c5a56a3440 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:55.724630 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1047/2088] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:55 2022] PUT /identity/v3/projects/acc6a560caaf472aa26af3f89cdb833c/users/3442c1e1c9214ed69ae4211fcb7d7c15/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:55.726617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb6a24-0f95-4e28-ab41-6c06c1fbc700 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.769916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1042/2089] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:26:55 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:55.772620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11e5a1-2732-4db0-ab64-4120b8990e50 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.773395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11e5a1-2732-4db0-ab64-4120b8990e50 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.774500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11e5a1-2732-4db0-ab64-4120b8990e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.798410 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb6a24-0f95-4e28-ab41-6c06c1fbc700 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.831007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ff11e5a1-2732-4db0-ab64-4120b8990e50 None None] MFA Rules not processed for user `3442c1e1c9214ed69ae4211fcb7d7c15`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:55.850291 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ff11e5a1-2732-4db0-ab64-4120b8990e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:55.876831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0f04d-b04a-4df3-baa3-958b7adfd578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.877823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0f04d-b04a-4df3-baa3-958b7adfd578 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.878143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0f04d-b04a-4df3-baa3-958b7adfd578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.878426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0f04d-b04a-4df3-baa3-958b7adfd578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.879794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0f04d-b04a-4df3-baa3-958b7adfd578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.881707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0f04d-b04a-4df3-baa3-958b7adfd578 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:55.893186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1048/2090] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:55.894188 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0f04d-b04a-4df3-baa3-958b7adfd578 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.905761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0f04d-b04a-4df3-baa3-958b7adfd578 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.912653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4c981-5cc9-487c-b5be-15a653bb1776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.913482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c981-5cc9-487c-b5be-15a653bb1776 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.914881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c981-5cc9-487c-b5be-15a653bb1776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.914881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c981-5cc9-487c-b5be-15a653bb1776 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.915054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4c981-5cc9-487c-b5be-15a653bb1776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.917696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4c981-5cc9-487c-b5be-15a653bb1776 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:55.941672 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1043/2091] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:55.942802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11e5a1-2732-4db0-ab64-4120b8990e50 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:55.956912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11e5a1-2732-4db0-ab64-4120b8990e50 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:55.961832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0a471-f5da-4c29-b822-545b4bcd2a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:55.963110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0a471-f5da-4c29-b822-545b4bcd2a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:55.963394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0a471-f5da-4c29-b822-545b4bcd2a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:55.963671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0a471-f5da-4c29-b822-545b4bcd2a79 admin admin] PATH_INFO: `/v3/projects/4f3441275f5d4e45ad99177d3fc44a50/users/080757f3006946a591d138d04824a710/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:55.984733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0a471-f5da-4c29-b822-545b4bcd2a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3441275f5d4e45ad99177d3fc44a50, user_id=080757f3006946a591d138d04824a710, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:55.987461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0a471-f5da-4c29-b822-545b4bcd2a79 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:56.034992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1049/2092] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:26:55 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:26:56.035854 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4c981-5cc9-487c-b5be-15a653bb1776 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:56.038752 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-29a4c981-5cc9-487c-b5be-15a653bb1776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:56.130908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4c981-5cc9-487c-b5be-15a653bb1776 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:56.135946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1044/2093] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:55 2022] PUT /identity/v3/projects/4f3441275f5d4e45ad99177d3fc44a50/users/080757f3006946a591d138d04824a710/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:56.137199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0a471-f5da-4c29-b822-545b4bcd2a79 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:56.189987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a281720-8818-4f72-8173-83f00870634d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:56.190680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a281720-8818-4f72-8173-83f00870634d service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:56.190966 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a281720-8818-4f72-8173-83f00870634d service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:56.191330 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a281720-8818-4f72-8173-83f00870634d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:56.218666 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0a471-f5da-4c29-b822-545b4bcd2a79 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:56.226339 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be2d34-30bb-4752-a991-8da55772a091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:56.227312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2d34-30bb-4752-a991-8da55772a091 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:56.227660 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2d34-30bb-4752-a991-8da55772a091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:56.228004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2d34-30bb-4752-a991-8da55772a091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:56.229005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be2d34-30bb-4752-a991-8da55772a091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:56.230610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be2d34-30bb-4752-a991-8da55772a091 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:56.243880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1045/2094] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:56.245790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be2d34-30bb-4752-a991-8da55772a091 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:56.256104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be2d34-30bb-4752-a991-8da55772a091 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:56.261198 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcde37a-b59a-4e4d-878c-b13eedad83b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:56.261877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcde37a-b59a-4e4d-878c-b13eedad83b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:56.262146 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcde37a-b59a-4e4d-878c-b13eedad83b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:56.262420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcde37a-b59a-4e4d-878c-b13eedad83b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:56.264900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcde37a-b59a-4e4d-878c-b13eedad83b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:56.265822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcde37a-b59a-4e4d-878c-b13eedad83b4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:56.280096 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1046/2095] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:56.280329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a281720-8818-4f72-8173-83f00870634d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:56.281409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcde37a-b59a-4e4d-878c-b13eedad83b4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:56.282436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a281720-8818-4f72-8173-83f00870634d service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:56.291787 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcde37a-b59a-4e4d-878c-b13eedad83b4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:56.293821 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1050/2096] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:56.294746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a281720-8818-4f72-8173-83f00870634d service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:56.298415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943bc35-147a-4c2e-83d0-1064a883853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:56.299453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943bc35-147a-4c2e-83d0-1064a883853b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:56.299834 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943bc35-147a-4c2e-83d0-1064a883853b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:56.300205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943bc35-147a-4c2e-83d0-1064a883853b admin admin] PATH_INFO: `/v3/projects/1809a0b944d44d258dfd637cbe2f02ad/users/c2b8d9dbe0424c1fa783b91d372667be/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:56.320653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943bc35-147a-4c2e-83d0-1064a883853b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1809a0b944d44d258dfd637cbe2f02ad, user_id=c2b8d9dbe0424c1fa783b91d372667be, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:56.323830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943bc35-147a-4c2e-83d0-1064a883853b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:56.325346 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a281720-8818-4f72-8173-83f00870634d service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:56.331510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ba415-c51d-4a25-bb24-c87c77163a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:56.332439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba415-c51d-4a25-bb24-c87c77163a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:56.332723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba415-c51d-4a25-bb24-c87c77163a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:56.333115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba415-c51d-4a25-bb24-c87c77163a42 admin admin] PATH_INFO: `/v3/projects/4f3441275f5d4e45ad99177d3fc44a50/users/080757f3006946a591d138d04824a710/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:56.335891 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ba415-c51d-4a25-bb24-c87c77163a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3441275f5d4e45ad99177d3fc44a50, user_id=080757f3006946a591d138d04824a710, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:56.338648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ba415-c51d-4a25-bb24-c87c77163a42 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:56.353597 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1051/2097] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:56 2022] PUT /identity/v3/projects/4f3441275f5d4e45ad99177d3fc44a50/users/080757f3006946a591d138d04824a710/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:56.365356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b396c0-05c1-4705-a011-5bc87c04bcc8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:56.365649 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b396c0-05c1-4705-a011-5bc87c04bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:56.365928 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b396c0-05c1-4705-a011-5bc87c04bcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:56.408547 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1047/2098] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:56 2022] PUT /identity/v3/projects/1809a0b944d44d258dfd637cbe2f02ad/users/c2b8d9dbe0424c1fa783b91d372667be/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:56.411085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-14b396c0-05c1-4705-a011-5bc87c04bcc8 None None] MFA Rules not processed for user `080757f3006946a591d138d04824a710`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:56.412503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943bc35-147a-4c2e-83d0-1064a883853b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:56.412777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-14b396c0-05c1-4705-a011-5bc87c04bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:56.528034 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943bc35-147a-4c2e-83d0-1064a883853b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:56.534948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f435ff2-f57b-49ed-92d6-efe7ae0e280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:56.535872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435ff2-f57b-49ed-92d6-efe7ae0e280b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:56.536432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435ff2-f57b-49ed-92d6-efe7ae0e280b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:56.536921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435ff2-f57b-49ed-92d6-efe7ae0e280b admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:56.538235 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f435ff2-f57b-49ed-92d6-efe7ae0e280b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:56.540182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f435ff2-f57b-49ed-92d6-efe7ae0e280b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:56.556023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1048/2099] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:26:56.558270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1052/2100] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:26:56.560127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f435ff2-f57b-49ed-92d6-efe7ae0e280b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:56.571828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f435ff2-f57b-49ed-92d6-efe7ae0e280b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:56.571999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b396c0-05c1-4705-a011-5bc87c04bcc8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:56.576827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d518e-e82e-4282-b5c2-9a3c2b19a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:56.578001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d518e-e82e-4282-b5c2-9a3c2b19a3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:56.578248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d518e-e82e-4282-b5c2-9a3c2b19a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:56.578593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d518e-e82e-4282-b5c2-9a3c2b19a3b4 admin admin] PATH_INFO: `/v3/projects/1809a0b944d44d258dfd637cbe2f02ad/users/c2b8d9dbe0424c1fa783b91d372667be/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:56.581833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d518e-e82e-4282-b5c2-9a3c2b19a3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1809a0b944d44d258dfd637cbe2f02ad, user_id=c2b8d9dbe0424c1fa783b91d372667be, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:56.584649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d518e-e82e-4282-b5c2-9a3c2b19a3b4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:56.596448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1049/2101] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:26:56 2022] PUT /identity/v3/projects/1809a0b944d44d258dfd637cbe2f02ad/users/c2b8d9dbe0424c1fa783b91d372667be/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:26:56.608621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b3aca-6b6a-4773-8aed-127748db7166 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:56.608881 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b3aca-6b6a-4773-8aed-127748db7166 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:56.609156 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b3aca-6b6a-4773-8aed-127748db7166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:56.701990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-375b3aca-6b6a-4773-8aed-127748db7166 None None] MFA Rules not processed for user `c2b8d9dbe0424c1fa783b91d372667be`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:56.703306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-375b3aca-6b6a-4773-8aed-127748db7166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:56.708298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b396c0-05c1-4705-a011-5bc87c04bcc8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:56.767126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9736-4115-4ae3-a902-e9f094ad06a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:56.767785 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9736-4115-4ae3-a902-e9f094ad06a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:56.768064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9736-4115-4ae3-a902-e9f094ad06a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:56.768334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9736-4115-4ae3-a902-e9f094ad06a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:56.784497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1050/2102] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:56.832978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a9736-4115-4ae3-a902-e9f094ad06a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:56.834513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a9736-4115-4ae3-a902-e9f094ad06a6 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:56.844649 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1053/2103] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:56.937920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b3aca-6b6a-4773-8aed-127748db7166 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:56.949367 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b3aca-6b6a-4773-8aed-127748db7166 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:56.953775 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b9fd8-a1c4-4e10-8b5f-e99a1760ddbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:56.954436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9fd8-a1c4-4e10-8b5f-e99a1760ddbd service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:56.954749 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9fd8-a1c4-4e10-8b5f-e99a1760ddbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:56.955172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9fd8-a1c4-4e10-8b5f-e99a1760ddbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:56.964644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b9fd8-a1c4-4e10-8b5f-e99a1760ddbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:56.966135 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b9fd8-a1c4-4e10-8b5f-e99a1760ddbd service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:56.975593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1051/2104] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:57.284325 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9736-4115-4ae3-a902-e9f094ad06a6 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:57.296605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9736-4115-4ae3-a902-e9f094ad06a6 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:57.307938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b568135-0747-4a61-b736-f2494ff11a91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:57.308603 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b568135-0747-4a61-b736-f2494ff11a91 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:57.308888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b568135-0747-4a61-b736-f2494ff11a91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:57.309197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b568135-0747-4a61-b736-f2494ff11a91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:57.382724 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b568135-0747-4a61-b736-f2494ff11a91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:57.384173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b568135-0747-4a61-b736-f2494ff11a91 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:57.393400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1054/2105] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:26:58.870729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b9fd8-a1c4-4e10-8b5f-e99a1760ddbd service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:58.948136 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b9fd8-a1c4-4e10-8b5f-e99a1760ddbd service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:58.952727 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:58.953617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:58.953895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:58.954166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] PATH_INFO: `/v3/users/27503be37e454494ab8a4bb96cf630b0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:58.955454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27503be37e454494ab8a4bb96cf630b0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:58.957404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:59.206698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27503be37e454494ab8a4bb96cf630b0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:59.219736 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27503be37e454494ab8a4bb96cf630b0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:59.312410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27503be37e454494ab8a4bb96cf630b0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:59.319993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27503be37e454494ab8a4bb96cf630b0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:59.320640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27503be37e454494ab8a4bb96cf630b0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:26:59.326487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1052/2106] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:26:58 2022] DELETE /identity/v3/users/27503be37e454494ab8a4bb96cf630b0 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:26:59.331146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693fdc1-92bc-464f-9efa-a77abc69787d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:59.331644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693fdc1-92bc-464f-9efa-a77abc69787d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:59.331737 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693fdc1-92bc-464f-9efa-a77abc69787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:59.349716 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f693fdc1-92bc-464f-9efa-a77abc69787d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:26:59.350986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f693fdc1-92bc-464f-9efa-a77abc69787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:59.410614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1055/2107] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:26:59.421181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:26:59.423707 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:26:59.489797 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56714ba5-5755-4ea6-ab3f-41c5d7994c56 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:26:59.495849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5b701-8409-4b23-980d-8f09864fc9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:26:59.496956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5b701-8409-4b23-980d-8f09864fc9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:26:59.497318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5b701-8409-4b23-980d-8f09864fc9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:26:59.497718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5b701-8409-4b23-980d-8f09864fc9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:26:59.508300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5b701-8409-4b23-980d-8f09864fc9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:26:59.509819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5b701-8409-4b23-980d-8f09864fc9c6 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:26:59.520465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1053/2108] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:27:00.126751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693fdc1-92bc-464f-9efa-a77abc69787d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:00.128225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f693fdc1-92bc-464f-9efa-a77abc69787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:00.139971 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693fdc1-92bc-464f-9efa-a77abc69787d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:00.144727 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:00.145614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:00.145895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:00.146168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] PATH_INFO: `/v3/projects/62b35280331c474cab91f78c592ef962` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:00.147336 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b35280331c474cab91f78c592ef962)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:00.149291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:00.279792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b35280331c474cab91f78c592ef962', 'request_id': 'req-333a65e4-b23f-4873-997a-21a9d688682e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:00.334998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b35280331c474cab91f78c592ef962', 'request_id': 'req-333a65e4-b23f-4873-997a-21a9d688682e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:00.341561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b35280331c474cab91f78c592ef962', 'request_id': 'req-333a65e4-b23f-4873-997a-21a9d688682e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:00.351912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] The token cache is being invalidate because project 62b35280331c474cab91f78c592ef962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:00.352194 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:00.352818 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:00.354529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1056/2109] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:00 2022] DELETE /identity/v3/projects/62b35280331c474cab91f78c592ef962 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:00.359396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5b701-8409-4b23-980d-8f09864fc9c6 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:00.368916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5b701-8409-4b23-980d-8f09864fc9c6 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:00.427151 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68c7c0-c088-4c54-8062-4861fc51d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:00.428037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c7c0-c088-4c54-8062-4861fc51d49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:00.430490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c7c0-c088-4c54-8062-4861fc51d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:00.430490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c7c0-c088-4c54-8062-4861fc51d49f admin admin] PATH_INFO: `/v3/users/080757f3006946a591d138d04824a710` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:00.430490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68c7c0-c088-4c54-8062-4861fc51d49f admin admin] RBAC: Authorizing `identity:delete_user(user_id=080757f3006946a591d138d04824a710)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:00.431706 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68c7c0-c088-4c54-8062-4861fc51d49f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:00.690242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0c68c7c0-c088-4c54-8062-4861fc51d49f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080757f3006946a591d138d04824a710'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:00.702524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0c68c7c0-c088-4c54-8062-4861fc51d49f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080757f3006946a591d138d04824a710'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:00.780863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0c68c7c0-c088-4c54-8062-4861fc51d49f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080757f3006946a591d138d04824a710'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:00.791617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0c68c7c0-c088-4c54-8062-4861fc51d49f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080757f3006946a591d138d04824a710'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:00.792358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0c68c7c0-c088-4c54-8062-4861fc51d49f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080757f3006946a591d138d04824a710'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:00.799041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1054/2110] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:00 2022] DELETE /identity/v3/users/080757f3006946a591d138d04824a710 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:01.307773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:01.309228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:01.323205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a65e4-b23f-4873-997a-21a9d688682e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:01.383021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:01.383913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:01.384189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:01.384488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] PATH_INFO: `/v3/projects/4f3441275f5d4e45ad99177d3fc44a50` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:01.385711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3441275f5d4e45ad99177d3fc44a50)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:01.387567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:01.493752 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3441275f5d4e45ad99177d3fc44a50', 'request_id': 'req-fba71b52-b197-418a-8018-23156364ba48'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:01.586593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3441275f5d4e45ad99177d3fc44a50', 'request_id': 'req-fba71b52-b197-418a-8018-23156364ba48'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:01.593240 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3441275f5d4e45ad99177d3fc44a50', 'request_id': 'req-fba71b52-b197-418a-8018-23156364ba48'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:01.603721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] The token cache is being invalidate because project 4f3441275f5d4e45ad99177d3fc44a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:01.604004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:01.604630 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fba71b52-b197-418a-8018-23156364ba48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:01.606178 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1057/2111] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:01 2022] DELETE /identity/v3/projects/4f3441275f5d4e45ad99177d3fc44a50 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:01.611863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85114f21-9caa-4ca3-b389-ae86b65cb306 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:01.612347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85114f21-9caa-4ca3-b389-ae86b65cb306 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:01.612448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85114f21-9caa-4ca3-b389-ae86b65cb306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:01.630434 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-85114f21-9caa-4ca3-b389-ae86b65cb306 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:01.631718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-85114f21-9caa-4ca3-b389-ae86b65cb306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:01.690891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1055/2112] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:01.698792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33a651-bc4b-4bb1-9336-3a55014b8003 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:01.699086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33a651-bc4b-4bb1-9336-3a55014b8003 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:01.699426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33a651-bc4b-4bb1-9336-3a55014b8003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:01.717800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ce33a651-bc4b-4bb1-9336-3a55014b8003 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:01.719000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ce33a651-bc4b-4bb1-9336-3a55014b8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:01.728104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1058/2113] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:01.732582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85114f21-9caa-4ca3-b389-ae86b65cb306 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:01.742772 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85114f21-9caa-4ca3-b389-ae86b65cb306 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:01.747397 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca61c92-76ad-43d2-a9dd-5e7fd0125a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:01.748047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca61c92-76ad-43d2-a9dd-5e7fd0125a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:01.748333 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca61c92-76ad-43d2-a9dd-5e7fd0125a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:01.748613 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca61c92-76ad-43d2-a9dd-5e7fd0125a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:01.749383 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca61c92-76ad-43d2-a9dd-5e7fd0125a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:27:01.749694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca61c92-76ad-43d2-a9dd-5e7fd0125a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:01.752281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca61c92-76ad-43d2-a9dd-5e7fd0125a5e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:01.763651 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1056/2114] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:27:01.768416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33a651-bc4b-4bb1-9336-3a55014b8003 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:01.777625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33a651-bc4b-4bb1-9336-3a55014b8003 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:01.782799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e54f57-d9fb-460e-ab7a-1cc6cb3c002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:01.783550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e54f57-d9fb-460e-ab7a-1cc6cb3c002c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:01.783828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e54f57-d9fb-460e-ab7a-1cc6cb3c002c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:01.784098 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e54f57-d9fb-460e-ab7a-1cc6cb3c002c admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:01.784775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e54f57-d9fb-460e-ab7a-1cc6cb3c002c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:01.786768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e54f57-d9fb-460e-ab7a-1cc6cb3c002c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:01.874792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1059/2115] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:01 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:01.879633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca61c92-76ad-43d2-a9dd-5e7fd0125a5e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:01.889649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca61c92-76ad-43d2-a9dd-5e7fd0125a5e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:01.957484 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffae14-5f97-4e05-bbd7-886c5cd32860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:01.958473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffae14-5f97-4e05-bbd7-886c5cd32860 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:01.958588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffae14-5f97-4e05-bbd7-886c5cd32860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:01.958995 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffae14-5f97-4e05-bbd7-886c5cd32860 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:01.959992 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffae14-5f97-4e05-bbd7-886c5cd32860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:01.962254 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffae14-5f97-4e05-bbd7-886c5cd32860 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:02.072918 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1057/2116] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:01 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:02.077391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e54f57-d9fb-460e-ab7a-1cc6cb3c002c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:02.088481 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e54f57-d9fb-460e-ab7a-1cc6cb3c002c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:02.094218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b308d70-70c5-46fb-a69f-aab1d9c0decf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:02.095124 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b308d70-70c5-46fb-a69f-aab1d9c0decf admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:02.095707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b308d70-70c5-46fb-a69f-aab1d9c0decf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:02.095707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b308d70-70c5-46fb-a69f-aab1d9c0decf admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:02.096431 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b308d70-70c5-46fb-a69f-aab1d9c0decf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:02.098053 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b308d70-70c5-46fb-a69f-aab1d9c0decf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:02.108920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1060/2117] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:02.113478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffae14-5f97-4e05-bbd7-886c5cd32860 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:02.123663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffae14-5f97-4e05-bbd7-886c5cd32860 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:02.129266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f073-60de-44e1-90ad-15e4b2842451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:02.129929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f073-60de-44e1-90ad-15e4b2842451 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:02.130211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f073-60de-44e1-90ad-15e4b2842451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:02.130488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f073-60de-44e1-90ad-15e4b2842451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:02.131210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f073-60de-44e1-90ad-15e4b2842451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:02.132808 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f073-60de-44e1-90ad-15e4b2842451 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:02.143428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1058/2118] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:02.151950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b308d70-70c5-46fb-a69f-aab1d9c0decf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:02.162103 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b308d70-70c5-46fb-a69f-aab1d9c0decf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:02.166675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e7b19-6b9d-4fd3-9dfa-ec9cef65ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:02.167555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e7b19-6b9d-4fd3-9dfa-ec9cef65ef1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:02.167875 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e7b19-6b9d-4fd3-9dfa-ec9cef65ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:02.168149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e7b19-6b9d-4fd3-9dfa-ec9cef65ef1d admin admin] PATH_INFO: `/v3/projects/ed653165403949249d36b3f20f8b119d/users/d15ea321038d4703bfb99724d55fbf34/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:02.182658 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e7b19-6b9d-4fd3-9dfa-ec9cef65ef1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed653165403949249d36b3f20f8b119d, user_id=d15ea321038d4703bfb99724d55fbf34, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:02.185502 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e7b19-6b9d-4fd3-9dfa-ec9cef65ef1d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:02.302008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1061/2119] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:02 2022] PUT /identity/v3/projects/ed653165403949249d36b3f20f8b119d/users/d15ea321038d4703bfb99724d55fbf34/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:02.314459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3aaf80-c6d0-41e0-91b5-0406944cde0f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:02.314770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3aaf80-c6d0-41e0-91b5-0406944cde0f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:02.315592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3aaf80-c6d0-41e0-91b5-0406944cde0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:02.342636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0b3aaf80-c6d0-41e0-91b5-0406944cde0f None None] MFA Rules not processed for user `d15ea321038d4703bfb99724d55fbf34`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:02.344415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0b3aaf80-c6d0-41e0-91b5-0406944cde0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:02.408284 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1059/2120] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:02.412674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e7b19-6b9d-4fd3-9dfa-ec9cef65ef1d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:02.476097 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e7b19-6b9d-4fd3-9dfa-ec9cef65ef1d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:02.480743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd951b2-6200-4073-847f-581cd2ed2577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:02.481437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd951b2-6200-4073-847f-581cd2ed2577 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:02.481721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd951b2-6200-4073-847f-581cd2ed2577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:02.481997 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd951b2-6200-4073-847f-581cd2ed2577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:02.482720 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd951b2-6200-4073-847f-581cd2ed2577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:02.484634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd951b2-6200-4073-847f-581cd2ed2577 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:02.622032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1062/2121] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:02 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:27:02.626845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3aaf80-c6d0-41e0-91b5-0406944cde0f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:02.637590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3aaf80-c6d0-41e0-91b5-0406944cde0f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:02.694385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ecb2a-d1b0-40fb-94d2-c99bec61df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:02.695052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ecb2a-d1b0-40fb-94d2-c99bec61df50 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:02.695342 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ecb2a-d1b0-40fb-94d2-c99bec61df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:02.695609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ecb2a-d1b0-40fb-94d2-c99bec61df50 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:02.696310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ecb2a-d1b0-40fb-94d2-c99bec61df50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:02.698266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ecb2a-d1b0-40fb-94d2-c99bec61df50 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:02.821310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1060/2122] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:02 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:02.825424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd951b2-6200-4073-847f-581cd2ed2577 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:02.835874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd951b2-6200-4073-847f-581cd2ed2577 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:02.840493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa1f46-5f70-4550-95f1-e973a1ded69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:02.841343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1f46-5f70-4550-95f1-e973a1ded69f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:02.841627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1f46-5f70-4550-95f1-e973a1ded69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:02.841921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1f46-5f70-4550-95f1-e973a1ded69f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:02.842703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa1f46-5f70-4550-95f1-e973a1ded69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:02.844479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa1f46-5f70-4550-95f1-e973a1ded69f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:02.856090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1063/2123] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:02.865036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ecb2a-d1b0-40fb-94d2-c99bec61df50 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:02.874983 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ecb2a-d1b0-40fb-94d2-c99bec61df50 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:02.879902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdd10a-30d7-4fc2-b959-d86e12f572b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:02.880775 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdd10a-30d7-4fc2-b959-d86e12f572b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:02.881076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdd10a-30d7-4fc2-b959-d86e12f572b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:02.881348 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdd10a-30d7-4fc2-b959-d86e12f572b7 admin admin] PATH_INFO: `/v3/projects/e2e1455551ae4f0ca7585be7be20702f/users/b169658a6ebf4a378001132ced5f6d83/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:02.897326 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdd10a-30d7-4fc2-b959-d86e12f572b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e1455551ae4f0ca7585be7be20702f, user_id=b169658a6ebf4a378001132ced5f6d83, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:02.899957 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdd10a-30d7-4fc2-b959-d86e12f572b7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:02.993178 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1061/2124] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:02 2022] PUT /identity/v3/projects/e2e1455551ae4f0ca7585be7be20702f/users/b169658a6ebf4a378001132ced5f6d83/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:02.997892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa1f46-5f70-4550-95f1-e973a1ded69f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:03.008385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa1f46-5f70-4550-95f1-e973a1ded69f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:03.099392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f2b62-00dd-45b7-98e0-0d6a1c0720ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:03.100136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2b62-00dd-45b7-98e0-0d6a1c0720ab admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:03.100486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2b62-00dd-45b7-98e0-0d6a1c0720ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:03.100791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2b62-00dd-45b7-98e0-0d6a1c0720ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:03.101570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f2b62-00dd-45b7-98e0-0d6a1c0720ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:03.103232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f2b62-00dd-45b7-98e0-0d6a1c0720ab admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:03.114222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1064/2125] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:03.118464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdd10a-30d7-4fc2-b959-d86e12f572b7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:03.132495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdd10a-30d7-4fc2-b959-d86e12f572b7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:03.137357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224473f-e9c6-4145-8870-e62cbc128c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:03.138240 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224473f-e9c6-4145-8870-e62cbc128c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:03.138523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224473f-e9c6-4145-8870-e62cbc128c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:03.140868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224473f-e9c6-4145-8870-e62cbc128c35 admin admin] PATH_INFO: `/v3/projects/e2e1455551ae4f0ca7585be7be20702f/users/b169658a6ebf4a378001132ced5f6d83/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:03.140868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224473f-e9c6-4145-8870-e62cbc128c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e1455551ae4f0ca7585be7be20702f, user_id=b169658a6ebf4a378001132ced5f6d83, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:03.144050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224473f-e9c6-4145-8870-e62cbc128c35 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:03.154514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1062/2126] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:03 2022] PUT /identity/v3/projects/e2e1455551ae4f0ca7585be7be20702f/users/b169658a6ebf4a378001132ced5f6d83/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:03.165347 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a83a7-ad27-4e23-934c-b60bd778fdc3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:03.165644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a83a7-ad27-4e23-934c-b60bd778fdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:03.169841 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a83a7-ad27-4e23-934c-b60bd778fdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:03.196496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ad6a83a7-ad27-4e23-934c-b60bd778fdc3 None None] MFA Rules not processed for user `b169658a6ebf4a378001132ced5f6d83`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:03.196496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ad6a83a7-ad27-4e23-934c-b60bd778fdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:03.289109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1065/2127] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:03.560403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224473f-e9c6-4145-8870-e62cbc128c35 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:03.562274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f224473f-e9c6-4145-8870-e62cbc128c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:03.619313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224473f-e9c6-4145-8870-e62cbc128c35 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:03.622840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaba6d-7910-4fe4-b3ad-720840673a68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:03.623481 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaba6d-7910-4fe4-b3ad-720840673a68 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:03.623763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaba6d-7910-4fe4-b3ad-720840673a68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:03.624042 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaba6d-7910-4fe4-b3ad-720840673a68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:03.633421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaba6d-7910-4fe4-b3ad-720840673a68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:03.634842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaba6d-7910-4fe4-b3ad-720840673a68 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:03.645301 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1063/2128] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:27:03.802692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a83a7-ad27-4e23-934c-b60bd778fdc3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:03.812033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a83a7-ad27-4e23-934c-b60bd778fdc3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:03.816842 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe84c6b-e721-4a92-8c7a-1df913165d38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:03.817525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe84c6b-e721-4a92-8c7a-1df913165d38 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:03.820480 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe84c6b-e721-4a92-8c7a-1df913165d38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:03.820480 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe84c6b-e721-4a92-8c7a-1df913165d38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:03.875325 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe84c6b-e721-4a92-8c7a-1df913165d38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:03.875740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaba6d-7910-4fe4-b3ad-720840673a68 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:03.877789 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe84c6b-e721-4a92-8c7a-1df913165d38 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:03.878333 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b7aaba6d-7910-4fe4-b3ad-720840673a68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:03.887618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1066/2129] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:03.944605 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaba6d-7910-4fe4-b3ad-720840673a68 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:03.949258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:03.950134 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:03.950441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:03.950727 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] PATH_INFO: `/v3/users/44769305fbc34e73bd4e9b1ca69f8cd6` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:03.951931 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44769305fbc34e73bd4e9b1ca69f8cd6)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:03.953856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:04.171664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44769305fbc34e73bd4e9b1ca69f8cd6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:04.184152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44769305fbc34e73bd4e9b1ca69f8cd6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:04.295170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44769305fbc34e73bd4e9b1ca69f8cd6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:04.305578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44769305fbc34e73bd4e9b1ca69f8cd6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:04.305578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44769305fbc34e73bd4e9b1ca69f8cd6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:04.310399 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1064/2130] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:03 2022] DELETE /identity/v3/users/44769305fbc34e73bd4e9b1ca69f8cd6 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:04.315282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014049a6-85cf-4a0b-acb6-210bc4e6fef2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:04.315575 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014049a6-85cf-4a0b-acb6-210bc4e6fef2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:04.315846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014049a6-85cf-4a0b-acb6-210bc4e6fef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:04.332929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-014049a6-85cf-4a0b-acb6-210bc4e6fef2 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:04.334475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-014049a6-85cf-4a0b-acb6-210bc4e6fef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:04.400214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:04.401688 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:04.402829 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1067/2131] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:04.412694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014049a6-85cf-4a0b-acb6-210bc4e6fef2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:04.414216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-014049a6-85cf-4a0b-acb6-210bc4e6fef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:04.416590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f401c-2723-4de4-a635-956870e325b6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:04.432351 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:04.433272 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:04.433558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:04.433837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] PATH_INFO: `/v3/users/d15ea321038d4703bfb99724d55fbf34` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:04.435071 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d15ea321038d4703bfb99724d55fbf34)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:04.437069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:04.477593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014049a6-85cf-4a0b-acb6-210bc4e6fef2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:04.481473 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b362fa-ccc0-4d69-aee2-c0997270389d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:04.482133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b362fa-ccc0-4d69-aee2-c0997270389d service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:04.482417 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b362fa-ccc0-4d69-aee2-c0997270389d service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:04.482721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b362fa-ccc0-4d69-aee2-c0997270389d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:04.492554 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b362fa-ccc0-4d69-aee2-c0997270389d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:04.494067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b362fa-ccc0-4d69-aee2-c0997270389d service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:04.504749 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1068/2132] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:27:04.629010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd15ea321038d4703bfb99724d55fbf34'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:04.641035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd15ea321038d4703bfb99724d55fbf34'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:04.697343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd15ea321038d4703bfb99724d55fbf34'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:04.707399 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd15ea321038d4703bfb99724d55fbf34'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:04.708187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd15ea321038d4703bfb99724d55fbf34'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:04.716523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1065/2133] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:04 2022] DELETE /identity/v3/users/d15ea321038d4703bfb99724d55fbf34 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:04.722573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7010-48a5-4cfa-ad1e-14106100fb47 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:04.722868 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7010-48a5-4cfa-ad1e-14106100fb47 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:04.723174 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7010-48a5-4cfa-ad1e-14106100fb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:04.742831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-080f7010-48a5-4cfa-ad1e-14106100fb47 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:04.744117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-080f7010-48a5-4cfa-ad1e-14106100fb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:04.814197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1069/2134] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:04.824753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:04.826346 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:04.883945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac9578-d998-42e5-85e2-891271fc5e28 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:04.887641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497adac3-4d66-46bd-886f-8957a77ffde0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:04.893777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497adac3-4d66-46bd-886f-8957a77ffde0 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:04.893777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497adac3-4d66-46bd-886f-8957a77ffde0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:04.893777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497adac3-4d66-46bd-886f-8957a77ffde0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:04.894110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f7010-48a5-4cfa-ad1e-14106100fb47 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:04.897182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-080f7010-48a5-4cfa-ad1e-14106100fb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:04.903869 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497adac3-4d66-46bd-886f-8957a77ffde0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:04.905572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497adac3-4d66-46bd-886f-8957a77ffde0 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:04.917457 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1066/2135] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:27:04.929160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f7010-48a5-4cfa-ad1e-14106100fb47 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:04.938193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:04.939696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:04.940330 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:04.940846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] PATH_INFO: `/v3/projects/46f77bd017ea4c07966cdf7c6d14ef99` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:04.942285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f77bd017ea4c07966cdf7c6d14ef99)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:04.944346 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:05.077194 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f77bd017ea4c07966cdf7c6d14ef99', 'request_id': 'req-db6637bc-034c-493b-a186-668066a82d69'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.139827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f77bd017ea4c07966cdf7c6d14ef99', 'request_id': 'req-db6637bc-034c-493b-a186-668066a82d69'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.146580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f77bd017ea4c07966cdf7c6d14ef99', 'request_id': 'req-db6637bc-034c-493b-a186-668066a82d69'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.157790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] The token cache is being invalidate because project 46f77bd017ea4c07966cdf7c6d14ef99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:05.158088 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.158770 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.160569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1070/2136] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:04 2022] DELETE /identity/v3/projects/46f77bd017ea4c07966cdf7c6d14ef99 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:05.164618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497adac3-4d66-46bd-886f-8957a77ffde0 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:05.175962 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497adac3-4d66-46bd-886f-8957a77ffde0 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:05.233963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:05.234853 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:05.235132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:05.235949 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] PATH_INFO: `/v3/users/2333b1a17ab9417c88c7a888dbc3da84` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:05.237846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2333b1a17ab9417c88c7a888dbc3da84)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:05.239789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:05.465856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2333b1a17ab9417c88c7a888dbc3da84'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.487420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2333b1a17ab9417c88c7a888dbc3da84'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.546473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2333b1a17ab9417c88c7a888dbc3da84'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.556123 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2333b1a17ab9417c88c7a888dbc3da84'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.556999 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2333b1a17ab9417c88c7a888dbc3da84'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.564774 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1067/2137] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:05 2022] DELETE /identity/v3/users/2333b1a17ab9417c88c7a888dbc3da84 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:05.640029 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:05.642121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:05.659831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6637bc-034c-493b-a186-668066a82d69 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:05.737218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:05.738211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:05.738532 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:05.738919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] PATH_INFO: `/v3/projects/ed653165403949249d36b3f20f8b119d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:05.740309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed653165403949249d36b3f20f8b119d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:05.742298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:05.868007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed653165403949249d36b3f20f8b119d', 'request_id': 'req-69e025ea-4c39-4338-9462-57e236f4e841'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.935001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed653165403949249d36b3f20f8b119d', 'request_id': 'req-69e025ea-4c39-4338-9462-57e236f4e841'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.942778 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed653165403949249d36b3f20f8b119d', 'request_id': 'req-69e025ea-4c39-4338-9462-57e236f4e841'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.953789 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] The token cache is being invalidate because project ed653165403949249d36b3f20f8b119d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:05.954108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.955583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:05.957197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1071/2138] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:05 2022] DELETE /identity/v3/projects/ed653165403949249d36b3f20f8b119d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:05.961176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:05.962745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:05.982404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cb188-bc4d-4fe8-8320-e3b0300609c8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:06.038844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:06.039677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:06.039958 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:06.040231 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] PATH_INFO: `/v3/users/b169658a6ebf4a378001132ced5f6d83` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:06.041448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b169658a6ebf4a378001132ced5f6d83)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:06.043360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:06.045881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:06.047583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:06.063690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e025ea-4c39-4338-9462-57e236f4e841 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:06.070337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:06.074444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:06.074444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:06.074444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] PATH_INFO: `/v3/projects/45e033a342f545aaaaac4663e28cbaf3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:06.074444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e033a342f545aaaaac4663e28cbaf3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:06.075494 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:06.255961 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e033a342f545aaaaac4663e28cbaf3', 'request_id': 'req-2f58a99f-ce92-4559-bceb-345987dd444a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:06.256155 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b169658a6ebf4a378001132ced5f6d83'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:06.268384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b169658a6ebf4a378001132ced5f6d83'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:06.363709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e033a342f545aaaaac4663e28cbaf3', 'request_id': 'req-2f58a99f-ce92-4559-bceb-345987dd444a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:06.370513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e033a342f545aaaaac4663e28cbaf3', 'request_id': 'req-2f58a99f-ce92-4559-bceb-345987dd444a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:06.380435 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] The token cache is being invalidate because project 45e033a342f545aaaaac4663e28cbaf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:06.380714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:06.381377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2f58a99f-ce92-4559-bceb-345987dd444a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:06.382917 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1072/2139] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:06 2022] DELETE /identity/v3/projects/45e033a342f545aaaaac4663e28cbaf3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:06.387623 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd0793-84b3-4449-bc28-a5896c3121d3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:06.387909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd0793-84b3-4449-bc28-a5896c3121d3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:06.388180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd0793-84b3-4449-bc28-a5896c3121d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:06.405964 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0ecd0793-84b3-4449-bc28-a5896c3121d3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:06.407139 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0ecd0793-84b3-4449-bc28-a5896c3121d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:06.460850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b169658a6ebf4a378001132ced5f6d83'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:06.469008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b169658a6ebf4a378001132ced5f6d83'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:06.469882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b169658a6ebf4a378001132ced5f6d83'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:06.471751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1073/2140] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:06.477190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1068/2141] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:05 2022] DELETE /identity/v3/users/b169658a6ebf4a378001132ced5f6d83 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:06.479572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27056a49-033c-4af8-80bb-d74bc626453f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:06.479995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27056a49-033c-4af8-80bb-d74bc626453f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:06.480284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27056a49-033c-4af8-80bb-d74bc626453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:06.498880 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-27056a49-033c-4af8-80bb-d74bc626453f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:06.500087 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-27056a49-033c-4af8-80bb-d74bc626453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:06.569317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1074/2142] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:06.573658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:06.584727 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11248d-07dc-4fef-a87b-eb15635e6c24 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:06.589567 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0605fa-7367-4e2b-b008-99ae0a437f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:06.590232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0605fa-7367-4e2b-b008-99ae0a437f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:06.592464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0605fa-7367-4e2b-b008-99ae0a437f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:06.592464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0605fa-7367-4e2b-b008-99ae0a437f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:06.592464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0605fa-7367-4e2b-b008-99ae0a437f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:27:06.592464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0605fa-7367-4e2b-b008-99ae0a437f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:06.593482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0605fa-7367-4e2b-b008-99ae0a437f5d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:06.606421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1069/2143] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:27:06.611813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27056a49-033c-4af8-80bb-d74bc626453f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:06.621721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27056a49-033c-4af8-80bb-d74bc626453f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:06.627199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e9180-dd97-4f6b-85b0-6e33463a2d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:06.627891 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e9180-dd97-4f6b-85b0-6e33463a2d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:06.628292 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e9180-dd97-4f6b-85b0-6e33463a2d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:06.628575 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e9180-dd97-4f6b-85b0-6e33463a2d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:06.629311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e9180-dd97-4f6b-85b0-6e33463a2d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:06.631551 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e9180-dd97-4f6b-85b0-6e33463a2d78 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:06.728600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1075/2144] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:06 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:27:06.732387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0605fa-7367-4e2b-b008-99ae0a437f5d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:06.744258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0605fa-7367-4e2b-b008-99ae0a437f5d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:06.840183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00a3e4-bdba-43a1-b095-077c5097091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:06.841589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00a3e4-bdba-43a1-b095-077c5097091e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:06.841589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00a3e4-bdba-43a1-b095-077c5097091e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:06.841589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00a3e4-bdba-43a1-b095-077c5097091e admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:06.842500 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00a3e4-bdba-43a1-b095-077c5097091e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:06.844464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00a3e4-bdba-43a1-b095-077c5097091e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:06.943733 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e9180-dd97-4f6b-85b0-6e33463a2d78 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:06.947847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1070/2145] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:06 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:06.947967 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-183e9180-dd97-4f6b-85b0-6e33463a2d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:06.949672 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00a3e4-bdba-43a1-b095-077c5097091e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:06.964259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e9180-dd97-4f6b-85b0-6e33463a2d78 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:06.966387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00a3e4-bdba-43a1-b095-077c5097091e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:06.973037 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:06.974313 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:06.974485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81d9aa-7fc8-4e02-9f78-7c6cde81d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:06.974606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:06.974837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] PATH_INFO: `/v3/projects/e2e1455551ae4f0ca7585be7be20702f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:06.975239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81d9aa-7fc8-4e02-9f78-7c6cde81d0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:06.975589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81d9aa-7fc8-4e02-9f78-7c6cde81d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:06.975879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81d9aa-7fc8-4e02-9f78-7c6cde81d0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:06.976192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e1455551ae4f0ca7585be7be20702f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:06.977141 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81d9aa-7fc8-4e02-9f78-7c6cde81d0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:06.978324 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:06.986195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81d9aa-7fc8-4e02-9f78-7c6cde81d0f0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:06.997010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1071/2146] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:27:07.000618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81d9aa-7fc8-4e02-9f78-7c6cde81d0f0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.010936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81d9aa-7fc8-4e02-9f78-7c6cde81d0f0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.015505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321c2f8-3b7e-496e-a902-b5be444dec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.016150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321c2f8-3b7e-496e-a902-b5be444dec45 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.016431 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321c2f8-3b7e-496e-a902-b5be444dec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.016733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321c2f8-3b7e-496e-a902-b5be444dec45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.017824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321c2f8-3b7e-496e-a902-b5be444dec45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.019394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321c2f8-3b7e-496e-a902-b5be444dec45 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.029687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1072/2147] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:27:07.033979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321c2f8-3b7e-496e-a902-b5be444dec45 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.043903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321c2f8-3b7e-496e-a902-b5be444dec45 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.050473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8fb83-a160-4b1d-bc76-509bf7545cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.053680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8fb83-a160-4b1d-bc76-509bf7545cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.053680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8fb83-a160-4b1d-bc76-509bf7545cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.053680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8fb83-a160-4b1d-bc76-509bf7545cc8 admin admin] PATH_INFO: `/v3/projects/a2faee9a00794d808b08408f47a5bbd2/users/dd2970a21c484c4f831d97056cdb5996/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.077132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8fb83-a160-4b1d-bc76-509bf7545cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2faee9a00794d808b08408f47a5bbd2, user_id=dd2970a21c484c4f831d97056cdb5996, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.080085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8fb83-a160-4b1d-bc76-509bf7545cc8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.181280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1073/2148] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:07 2022] PUT /identity/v3/projects/a2faee9a00794d808b08408f47a5bbd2/users/dd2970a21c484c4f831d97056cdb5996/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:07.189025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e1455551ae4f0ca7585be7be20702f', 'request_id': 'req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:07.193246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f2eed-4c0c-4e9a-b23d-b8c9ba488743 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.193535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f2eed-4c0c-4e9a-b23d-b8c9ba488743 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.193814 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f2eed-4c0c-4e9a-b23d-b8c9ba488743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.220979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-263f2eed-4c0c-4e9a-b23d-b8c9ba488743 None None] MFA Rules not processed for user `dd2970a21c484c4f831d97056cdb5996`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:07.222025 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-263f2eed-4c0c-4e9a-b23d-b8c9ba488743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:07.266475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e1455551ae4f0ca7585be7be20702f', 'request_id': 'req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:07.273988 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e1455551ae4f0ca7585be7be20702f', 'request_id': 'req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:07.285385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] The token cache is being invalidate because project e2e1455551ae4f0ca7585be7be20702f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:07.285679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:07.286314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d456f96-eb94-4062-ab5a-9d6cb3f6849b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:07.286729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1074/2149] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:07.288184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1076/2150] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:06 2022] DELETE /identity/v3/projects/e2e1455551ae4f0ca7585be7be20702f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:07.292298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f2eed-4c0c-4e9a-b23d-b8c9ba488743 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.292757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4c74e-d6cc-4d24-9445-c8c79819a4cc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.293089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4c74e-d6cc-4d24-9445-c8c79819a4cc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.293374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4c74e-d6cc-4d24-9445-c8c79819a4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.311507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-43c4c74e-d6cc-4d24-9445-c8c79819a4cc None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:07.312696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-43c4c74e-d6cc-4d24-9445-c8c79819a4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:07.353291 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f2eed-4c0c-4e9a-b23d-b8c9ba488743 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.357843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad66cf4-c7b1-489f-a432-a10a2ac99968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.358520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66cf4-c7b1-489f-a432-a10a2ac99968 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.358804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66cf4-c7b1-489f-a432-a10a2ac99968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.359077 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66cf4-c7b1-489f-a432-a10a2ac99968 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.359773 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad66cf4-c7b1-489f-a432-a10a2ac99968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.362232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad66cf4-c7b1-489f-a432-a10a2ac99968 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.369861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1077/2151] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:07.379754 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0beca9-e262-46e5-9e00-bff5e7c5c88e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.380266 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0beca9-e262-46e5-9e00-bff5e7c5c88e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.380640 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0beca9-e262-46e5-9e00-bff5e7c5c88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.398738 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4b0beca9-e262-46e5-9e00-bff5e7c5c88e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:07.399963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4b0beca9-e262-46e5-9e00-bff5e7c5c88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:07.409233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1078/2152] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:07.413465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0beca9-e262-46e5-9e00-bff5e7c5c88e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.422294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0beca9-e262-46e5-9e00-bff5e7c5c88e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.427716 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c503a23-04a3-4852-b612-56b310973c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.428360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503a23-04a3-4852-b612-56b310973c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.428644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503a23-04a3-4852-b612-56b310973c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.435456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503a23-04a3-4852-b612-56b310973c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.435456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c503a23-04a3-4852-b612-56b310973c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:27:07.435456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c503a23-04a3-4852-b612-56b310973c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.435456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c503a23-04a3-4852-b612-56b310973c09 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.443296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1079/2153] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:27:07.447534 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c503a23-04a3-4852-b612-56b310973c09 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.457137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c503a23-04a3-4852-b612-56b310973c09 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.461686 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ce7c1-5b5e-49fa-b831-3df34383261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.462320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ce7c1-5b5e-49fa-b831-3df34383261b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.462599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ce7c1-5b5e-49fa-b831-3df34383261b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.462872 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ce7c1-5b5e-49fa-b831-3df34383261b admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.467637 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1075/2154] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:07 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:27:07.467744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ce7c1-5b5e-49fa-b831-3df34383261b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.467744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ce7c1-5b5e-49fa-b831-3df34383261b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.468514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad66cf4-c7b1-489f-a432-a10a2ac99968 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.470889 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aad66cf4-c7b1-489f-a432-a10a2ac99968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:07.533642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad66cf4-c7b1-489f-a432-a10a2ac99968 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.538326 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316861c-1e84-49aa-8102-dae481a5ff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.538996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316861c-1e84-49aa-8102-dae481a5ff4b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.539280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316861c-1e84-49aa-8102-dae481a5ff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.539558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316861c-1e84-49aa-8102-dae481a5ff4b admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.540290 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316861c-1e84-49aa-8102-dae481a5ff4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.542224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316861c-1e84-49aa-8102-dae481a5ff4b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.566497 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1080/2155] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:07 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:27:07.570676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ce7c1-5b5e-49fa-b831-3df34383261b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.631604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ce7c1-5b5e-49fa-b831-3df34383261b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.636302 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb94d20-fdc1-4e93-bb7e-81e76e12ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.636953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb94d20-fdc1-4e93-bb7e-81e76e12ad5f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.637265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb94d20-fdc1-4e93-bb7e-81e76e12ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.637539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb94d20-fdc1-4e93-bb7e-81e76e12ad5f admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.638219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb94d20-fdc1-4e93-bb7e-81e76e12ad5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.640139 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb94d20-fdc1-4e93-bb7e-81e76e12ad5f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.660057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1076/2156] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:07 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:27:07.664293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316861c-1e84-49aa-8102-dae481a5ff4b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.674586 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316861c-1e84-49aa-8102-dae481a5ff4b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.679654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa3634-41b7-4654-8e92-1d04205c2e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.680472 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa3634-41b7-4654-8e92-1d04205c2e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.680762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa3634-41b7-4654-8e92-1d04205c2e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.681080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa3634-41b7-4654-8e92-1d04205c2e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.681816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa3634-41b7-4654-8e92-1d04205c2e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.683452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa3634-41b7-4654-8e92-1d04205c2e98 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.694528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1077/2157] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:27:07.698494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa3634-41b7-4654-8e92-1d04205c2e98 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.708579 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa3634-41b7-4654-8e92-1d04205c2e98 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.713468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3a4ae-2ad1-4df2-ba9a-3d141c0a6102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.714333 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3a4ae-2ad1-4df2-ba9a-3d141c0a6102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.714670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3a4ae-2ad1-4df2-ba9a-3d141c0a6102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.714955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3a4ae-2ad1-4df2-ba9a-3d141c0a6102 admin admin] PATH_INFO: `/v3/projects/fe7d623ecee6403d8c4f5e3c82ef3ab4/users/4f277881f3244ae692eb05f2ef44884e/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.730240 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3a4ae-2ad1-4df2-ba9a-3d141c0a6102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7d623ecee6403d8c4f5e3c82ef3ab4, user_id=4f277881f3244ae692eb05f2ef44884e, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.733111 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3a4ae-2ad1-4df2-ba9a-3d141c0a6102 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.745775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1081/2158] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:07 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:27:07.749751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb94d20-fdc1-4e93-bb7e-81e76e12ad5f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.760058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb94d20-fdc1-4e93-bb7e-81e76e12ad5f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.764620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec3add-43b5-45fe-b082-6316396e1795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.765307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec3add-43b5-45fe-b082-6316396e1795 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.765587 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec3add-43b5-45fe-b082-6316396e1795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.765860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec3add-43b5-45fe-b082-6316396e1795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.767069 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec3add-43b5-45fe-b082-6316396e1795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.768663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec3add-43b5-45fe-b082-6316396e1795 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.778213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1082/2159] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:27:07.784131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec3add-43b5-45fe-b082-6316396e1795 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.793750 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec3add-43b5-45fe-b082-6316396e1795 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.798734 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d74ca-04cd-4ab1-b024-bc4baa065b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.799377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d74ca-04cd-4ab1-b024-bc4baa065b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.799673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d74ca-04cd-4ab1-b024-bc4baa065b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.799923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d74ca-04cd-4ab1-b024-bc4baa065b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.800656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d74ca-04cd-4ab1-b024-bc4baa065b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.802265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d74ca-04cd-4ab1-b024-bc4baa065b4d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.812169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1078/2160] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:07 2022] PUT /identity/v3/projects/fe7d623ecee6403d8c4f5e3c82ef3ab4/users/4f277881f3244ae692eb05f2ef44884e/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:07.816007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1083/2161] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:07.816840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3a4ae-2ad1-4df2-ba9a-3d141c0a6102 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.816988 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d74ca-04cd-4ab1-b024-bc4baa065b4d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.827490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d74ca-04cd-4ab1-b024-bc4baa065b4d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.893505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3a4ae-2ad1-4df2-ba9a-3d141c0a6102 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.898374 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0c453-bb2c-4f66-a899-823278cba8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.899204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c453-bb2c-4f66-a899-823278cba8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.899432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c453-bb2c-4f66-a899-823278cba8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.899704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c453-bb2c-4f66-a899-823278cba8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.900565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0c453-bb2c-4f66-a899-823278cba8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.901505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02376a-6d3f-4ebc-a01e-054778e95013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.902197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0c453-bb2c-4f66-a899-823278cba8b8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.902604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02376a-6d3f-4ebc-a01e-054778e95013 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.902972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02376a-6d3f-4ebc-a01e-054778e95013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.903338 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02376a-6d3f-4ebc-a01e-054778e95013 admin admin] PATH_INFO: `/v3/projects/686b0c6549e54920a69a161eabc4ba90/users/8f6e4928a7934ed8bd02aebb8a60e805/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.913421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1079/2162] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:07.917499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0c453-bb2c-4f66-a899-823278cba8b8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:07.923555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02376a-6d3f-4ebc-a01e-054778e95013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686b0c6549e54920a69a161eabc4ba90, user_id=8f6e4928a7934ed8bd02aebb8a60e805, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.926357 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02376a-6d3f-4ebc-a01e-054778e95013 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.927858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0c453-bb2c-4f66-a899-823278cba8b8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:07.932858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb8a3d-2e16-45cc-9a3d-5e3a6003c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:07.933781 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8a3d-2e16-45cc-9a3d-5e3a6003c55d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.934065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8a3d-2e16-45cc-9a3d-5e3a6003c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.934343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8a3d-2e16-45cc-9a3d-5e3a6003c55d admin admin] PATH_INFO: `/v3/projects/fe7d623ecee6403d8c4f5e3c82ef3ab4/users/4f277881f3244ae692eb05f2ef44884e/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.936467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb8a3d-2e16-45cc-9a3d-5e3a6003c55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7d623ecee6403d8c4f5e3c82ef3ab4, user_id=4f277881f3244ae692eb05f2ef44884e, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:07.939812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb8a3d-2e16-45cc-9a3d-5e3a6003c55d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:07.951288 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1080/2163] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:07 2022] PUT /identity/v3/projects/fe7d623ecee6403d8c4f5e3c82ef3ab4/users/4f277881f3244ae692eb05f2ef44884e/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:07.962024 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956feca-2fdb-4641-8039-b34aef857760 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:07.962322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956feca-2fdb-4641-8039-b34aef857760 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:07.962603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956feca-2fdb-4641-8039-b34aef857760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:07.991545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5956feca-2fdb-4641-8039-b34aef857760 None None] MFA Rules not processed for user `4f277881f3244ae692eb05f2ef44884e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:07.992778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5956feca-2fdb-4641-8039-b34aef857760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:07.994039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1084/2164] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:07 2022] PUT /identity/v3/projects/686b0c6549e54920a69a161eabc4ba90/users/8f6e4928a7934ed8bd02aebb8a60e805/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:08.006305 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738cc98-f59b-4936-a9d0-7e27902e635b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:08.006815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738cc98-f59b-4936-a9d0-7e27902e635b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:08.006991 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738cc98-f59b-4936-a9d0-7e27902e635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:08.035715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4738cc98-f59b-4936-a9d0-7e27902e635b None None] MFA Rules not processed for user `8f6e4928a7934ed8bd02aebb8a60e805`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:08.037050 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4738cc98-f59b-4936-a9d0-7e27902e635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:08.073753 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1081/2165] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:08.085426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956feca-2fdb-4641-8039-b34aef857760 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:08.086864 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5956feca-2fdb-4641-8039-b34aef857760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:08.108904 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1085/2166] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:08.122183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738cc98-f59b-4936-a9d0-7e27902e635b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:08.123965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4738cc98-f59b-4936-a9d0-7e27902e635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:08.166245 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956feca-2fdb-4641-8039-b34aef857760 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:08.170045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2587d-32c1-4764-a732-694a4384d0a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:08.170716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2587d-32c1-4764-a732-694a4384d0a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:08.170997 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2587d-32c1-4764-a732-694a4384d0a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:08.171273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2587d-32c1-4764-a732-694a4384d0a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:08.182183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2587d-32c1-4764-a732-694a4384d0a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:08.183652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2587d-32c1-4764-a732-694a4384d0a2 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:08.186653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738cc98-f59b-4936-a9d0-7e27902e635b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:08.191232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5d7a-2a93-4968-ae7b-105fb59c19b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:08.191900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5d7a-2a93-4968-ae7b-105fb59c19b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:08.192179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5d7a-2a93-4968-ae7b-105fb59c19b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:08.192449 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5d7a-2a93-4968-ae7b-105fb59c19b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:08.195056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1082/2167] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:08.201651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5d7a-2a93-4968-ae7b-105fb59c19b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:08.203102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5d7a-2a93-4968-ae7b-105fb59c19b5 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:08.213351 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1086/2168] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:27:08.234101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2587d-32c1-4764-a732-694a4384d0a2 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:08.311322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2587d-32c1-4764-a732-694a4384d0a2 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:08.318441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:08.319397 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:08.319680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:08.319957 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] PATH_INFO: `/v3/users/8f6e4928a7934ed8bd02aebb8a60e805` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:08.321341 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6e4928a7934ed8bd02aebb8a60e805)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:08.323337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:08.486894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6e4928a7934ed8bd02aebb8a60e805'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:08.498987 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6e4928a7934ed8bd02aebb8a60e805'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:08.569689 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6e4928a7934ed8bd02aebb8a60e805'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:08.580190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6e4928a7934ed8bd02aebb8a60e805'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:08.580694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6e4928a7934ed8bd02aebb8a60e805'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:08.587125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1083/2169] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:08 2022] DELETE /identity/v3/users/8f6e4928a7934ed8bd02aebb8a60e805 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:08.591831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0818811-7e43-4973-a2fa-0b8fbac052d2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:08.592129 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0818811-7e43-4973-a2fa-0b8fbac052d2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:08.592413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0818811-7e43-4973-a2fa-0b8fbac052d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:08.614390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c0818811-7e43-4973-a2fa-0b8fbac052d2 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:08.616493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c0818811-7e43-4973-a2fa-0b8fbac052d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:08.683258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1087/2170] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:08.694198 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:08.695649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:08.722296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0818811-7e43-4973-a2fa-0b8fbac052d2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:08.723731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c0818811-7e43-4973-a2fa-0b8fbac052d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:08.735681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0818811-7e43-4973-a2fa-0b8fbac052d2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:08.740614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:08.741519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:08.741803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:08.742080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] PATH_INFO: `/v3/users/dd2970a21c484c4f831d97056cdb5996` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:08.743292 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2970a21c484c4f831d97056cdb5996)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:08.745271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:08.760057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1a05c-f69b-4770-892a-26317fd51f29 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:08.763709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc29c5-0682-4b16-8302-14469706dec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:08.764334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc29c5-0682-4b16-8302-14469706dec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:08.764614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc29c5-0682-4b16-8302-14469706dec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:08.764887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc29c5-0682-4b16-8302-14469706dec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:08.775506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc29c5-0682-4b16-8302-14469706dec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:08.777064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc29c5-0682-4b16-8302-14469706dec9 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:08.787002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1084/2171] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:27:08.880627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2970a21c484c4f831d97056cdb5996'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:08.893114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2970a21c484c4f831d97056cdb5996'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:08.893845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2970a21c484c4f831d97056cdb5996'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:08.900881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2970a21c484c4f831d97056cdb5996'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:08.904901 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2970a21c484c4f831d97056cdb5996'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:08.988191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1088/2172] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:08 2022] DELETE /identity/v3/users/dd2970a21c484c4f831d97056cdb5996 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:08.992830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff6ff-6a6c-46c7-a2bc-99f1c8077177 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:08.993373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff6ff-6a6c-46c7-a2bc-99f1c8077177 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:08.993457 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff6ff-6a6c-46c7-a2bc-99f1c8077177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:09.014895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-151ff6ff-6a6c-46c7-a2bc-99f1c8077177 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:09.015905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-151ff6ff-6a6c-46c7-a2bc-99f1c8077177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:09.084551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1085/2173] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:09.101780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:09.103391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:09.170115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e66c5-185f-453c-8180-c1bc12720621 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:09.174937 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda262c-c446-4add-9da3-7a7be65a484d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:09.175578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda262c-c446-4add-9da3-7a7be65a484d service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:09.175859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda262c-c446-4add-9da3-7a7be65a484d service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:09.176132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda262c-c446-4add-9da3-7a7be65a484d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:09.185573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda262c-c446-4add-9da3-7a7be65a484d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:09.187226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda262c-c446-4add-9da3-7a7be65a484d service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:09.198360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1089/2174] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:27:09.237302 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff6ff-6a6c-46c7-a2bc-99f1c8077177 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:09.238718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-151ff6ff-6a6c-46c7-a2bc-99f1c8077177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:09.250639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff6ff-6a6c-46c7-a2bc-99f1c8077177 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:09.256475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:09.257363 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:09.257650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:09.257923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] PATH_INFO: `/v3/projects/686b0c6549e54920a69a161eabc4ba90` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:09.259104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=686b0c6549e54920a69a161eabc4ba90)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:09.261057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:09.393847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686b0c6549e54920a69a161eabc4ba90', 'request_id': 'req-937eac31-fd81-48c7-839a-c8b9eab1a45f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:09.472197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686b0c6549e54920a69a161eabc4ba90', 'request_id': 'req-937eac31-fd81-48c7-839a-c8b9eab1a45f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:09.478738 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686b0c6549e54920a69a161eabc4ba90', 'request_id': 'req-937eac31-fd81-48c7-839a-c8b9eab1a45f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:09.489684 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] The token cache is being invalidate because project 686b0c6549e54920a69a161eabc4ba90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:09.490429 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:09.491108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:09.492685 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1086/2175] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:09 2022] DELETE /identity/v3/projects/686b0c6549e54920a69a161eabc4ba90 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:09.764448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda262c-c446-4add-9da3-7a7be65a484d service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:09.765864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-abda262c-c446-4add-9da3-7a7be65a484d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:09.779409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda262c-c446-4add-9da3-7a7be65a484d service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:09.837807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:09.838664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:09.838946 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:09.839219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] PATH_INFO: `/v3/projects/a2faee9a00794d808b08408f47a5bbd2` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:09.840399 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2faee9a00794d808b08408f47a5bbd2)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:09.842363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:10.028676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2faee9a00794d808b08408f47a5bbd2', 'request_id': 'req-60130a69-de60-4aaa-9e1a-834e59c5b866'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:10.443826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2faee9a00794d808b08408f47a5bbd2', 'request_id': 'req-60130a69-de60-4aaa-9e1a-834e59c5b866'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:10.450839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2faee9a00794d808b08408f47a5bbd2', 'request_id': 'req-60130a69-de60-4aaa-9e1a-834e59c5b866'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:10.461843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] The token cache is being invalidate because project a2faee9a00794d808b08408f47a5bbd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:10.467837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:10.467837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:10.467837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1090/2176] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:09 2022] DELETE /identity/v3/projects/a2faee9a00794d808b08408f47a5bbd2 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:10.471106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:10.472643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:10.491279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eac31-fd81-48c7-839a-c8b9eab1a45f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:10.550522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4345b-7059-45da-aaa8-72165dd84ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:10.551335 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4345b-7059-45da-aaa8-72165dd84ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:10.551614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4345b-7059-45da-aaa8-72165dd84ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:10.551886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4345b-7059-45da-aaa8-72165dd84ad1 admin admin] PATH_INFO: `/v3/users/4f277881f3244ae692eb05f2ef44884e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:10.553162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4345b-7059-45da-aaa8-72165dd84ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f277881f3244ae692eb05f2ef44884e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:10.555377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4345b-7059-45da-aaa8-72165dd84ad1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:10.795126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30f4345b-7059-45da-aaa8-72165dd84ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f277881f3244ae692eb05f2ef44884e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:10.807013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30f4345b-7059-45da-aaa8-72165dd84ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f277881f3244ae692eb05f2ef44884e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:10.883646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30f4345b-7059-45da-aaa8-72165dd84ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f277881f3244ae692eb05f2ef44884e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:10.891250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30f4345b-7059-45da-aaa8-72165dd84ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f277881f3244ae692eb05f2ef44884e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:10.895379 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30f4345b-7059-45da-aaa8-72165dd84ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f277881f3244ae692eb05f2ef44884e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:10.898468 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1087/2177] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:10 2022] DELETE /identity/v3/users/4f277881f3244ae692eb05f2ef44884e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:11.355886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:11.357966 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:11.372912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60130a69-de60-4aaa-9e1a-834e59c5b866 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:11.449906 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:11.451113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:11.451309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:11.451589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] PATH_INFO: `/v3/projects/fe7d623ecee6403d8c4f5e3c82ef3ab4` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:11.452837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7d623ecee6403d8c4f5e3c82ef3ab4)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:11.455649 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:11.600598 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7d623ecee6403d8c4f5e3c82ef3ab4', 'request_id': 'req-12657de2-4de4-467a-9d08-c807fd8615ef'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:11.701485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7d623ecee6403d8c4f5e3c82ef3ab4', 'request_id': 'req-12657de2-4de4-467a-9d08-c807fd8615ef'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:11.709377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7d623ecee6403d8c4f5e3c82ef3ab4', 'request_id': 'req-12657de2-4de4-467a-9d08-c807fd8615ef'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:11.720616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] The token cache is being invalidate because project fe7d623ecee6403d8c4f5e3c82ef3ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:11.720908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:11.721722 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-12657de2-4de4-467a-9d08-c807fd8615ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:11.723450 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1091/2178] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:11 2022] DELETE /identity/v3/projects/fe7d623ecee6403d8c4f5e3c82ef3ab4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:11.728236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a9ec-3bd7-47ac-90a0-6e4a05bb14bf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:11.728677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a9ec-3bd7-47ac-90a0-6e4a05bb14bf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:11.728777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a9ec-3bd7-47ac-90a0-6e4a05bb14bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:11.747552 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d2b7a9ec-3bd7-47ac-90a0-6e4a05bb14bf None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:11.748766 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d2b7a9ec-3bd7-47ac-90a0-6e4a05bb14bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:11.812133 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1088/2179] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:11.820798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e26d80-28b1-4116-8bd5-b810d09fc3bc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:11.821120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e26d80-28b1-4116-8bd5-b810d09fc3bc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:11.821395 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e26d80-28b1-4116-8bd5-b810d09fc3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:11.843284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-99e26d80-28b1-4116-8bd5-b810d09fc3bc None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:11.843284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-99e26d80-28b1-4116-8bd5-b810d09fc3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:11.849132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1092/2180] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:11.853436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a9ec-3bd7-47ac-90a0-6e4a05bb14bf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:11.863833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a9ec-3bd7-47ac-90a0-6e4a05bb14bf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:11.868775 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7906f-2aec-437b-9ebb-92c8871082bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:11.869471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7906f-2aec-437b-9ebb-92c8871082bc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:11.869786 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7906f-2aec-437b-9ebb-92c8871082bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:11.870066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7906f-2aec-437b-9ebb-92c8871082bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:11.870793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7906f-2aec-437b-9ebb-92c8871082bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:27:11.871104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7906f-2aec-437b-9ebb-92c8871082bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:11.872723 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7906f-2aec-437b-9ebb-92c8871082bc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:11.884024 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1089/2181] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:27:11.888242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e26d80-28b1-4116-8bd5-b810d09fc3bc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:11.897779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e26d80-28b1-4116-8bd5-b810d09fc3bc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:11.903175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dac77f-f134-4623-9771-82edc5877964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:11.906137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dac77f-f134-4623-9771-82edc5877964 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:11.906137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dac77f-f134-4623-9771-82edc5877964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:11.906137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dac77f-f134-4623-9771-82edc5877964 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:11.906137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dac77f-f134-4623-9771-82edc5877964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:11.907025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dac77f-f134-4623-9771-82edc5877964 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:11.999736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1093/2182] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:11 2022] POST /identity/v3/projects => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:12.004222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7906f-2aec-437b-9ebb-92c8871082bc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:12.014355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7906f-2aec-437b-9ebb-92c8871082bc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:12.072464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d84cc7-8b84-43e4-b985-baebf8daeb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:12.073167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d84cc7-8b84-43e4-b985-baebf8daeb52 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:12.073452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d84cc7-8b84-43e4-b985-baebf8daeb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:12.073725 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d84cc7-8b84-43e4-b985-baebf8daeb52 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:12.074423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d84cc7-8b84-43e4-b985-baebf8daeb52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:12.076314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d84cc7-8b84-43e4-b985-baebf8daeb52 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:12.181084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1090/2183] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:12 2022] POST /identity/v3/users => generated 281 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:27:12.185094 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dac77f-f134-4623-9771-82edc5877964 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:12.195950 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dac77f-f134-4623-9771-82edc5877964 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:12.200900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3c3e6-30d4-40d6-862c-0d9021b863e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:12.201594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3c3e6-30d4-40d6-862c-0d9021b863e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:12.201883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3c3e6-30d4-40d6-862c-0d9021b863e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:12.202623 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3c3e6-30d4-40d6-862c-0d9021b863e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:12.202931 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3c3e6-30d4-40d6-862c-0d9021b863e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:12.205109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3c3e6-30d4-40d6-862c-0d9021b863e5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:12.219398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1094/2184] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:27:12.221397 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d84cc7-8b84-43e4-b985-baebf8daeb52 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:12.234520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d84cc7-8b84-43e4-b985-baebf8daeb52 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:12.239809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b6693-48e5-4b57-bd6b-eeb02803e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:12.240475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b6693-48e5-4b57-bd6b-eeb02803e38b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:12.240750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b6693-48e5-4b57-bd6b-eeb02803e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:12.241061 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b6693-48e5-4b57-bd6b-eeb02803e38b admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:12.241919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b6693-48e5-4b57-bd6b-eeb02803e38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:12.243741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b6693-48e5-4b57-bd6b-eeb02803e38b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:12.254921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1091/2185] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:12.259312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3c3e6-30d4-40d6-862c-0d9021b863e5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:12.271171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3c3e6-30d4-40d6-862c-0d9021b863e5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:12.276316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4808cfd-02de-45c1-a53a-e25d9833bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:12.277249 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4808cfd-02de-45c1-a53a-e25d9833bb37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:12.277539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4808cfd-02de-45c1-a53a-e25d9833bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:12.277819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4808cfd-02de-45c1-a53a-e25d9833bb37 admin admin] PATH_INFO: `/v3/projects/fc424635b0cb4cb9ba8303cdbeee1eea/users/143411a246434a049f9400d2b25a7cde/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:12.293324 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4808cfd-02de-45c1-a53a-e25d9833bb37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc424635b0cb4cb9ba8303cdbeee1eea, user_id=143411a246434a049f9400d2b25a7cde, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:12.296008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4808cfd-02de-45c1-a53a-e25d9833bb37 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:12.411523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1095/2186] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:12 2022] PUT /identity/v3/projects/fc424635b0cb4cb9ba8303cdbeee1eea/users/143411a246434a049f9400d2b25a7cde/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:12.423524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de6e07-e58f-4d07-ac91-84168e270937 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:12.423862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de6e07-e58f-4d07-ac91-84168e270937 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:12.424275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de6e07-e58f-4d07-ac91-84168e270937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:12.454908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-51de6e07-e58f-4d07-ac91-84168e270937 None None] MFA Rules not processed for user `143411a246434a049f9400d2b25a7cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:12.454908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-51de6e07-e58f-4d07-ac91-84168e270937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:12.518705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1092/2187] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:12.552563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4808cfd-02de-45c1-a53a-e25d9833bb37 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:12.554992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a4808cfd-02de-45c1-a53a-e25d9833bb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:12.617814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4808cfd-02de-45c1-a53a-e25d9833bb37 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:12.621714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd4027-837e-44b0-b295-ed3a3c201eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:12.622500 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd4027-837e-44b0-b295-ed3a3c201eed service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:12.622606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd4027-837e-44b0-b295-ed3a3c201eed service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:12.622885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd4027-837e-44b0-b295-ed3a3c201eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:12.632716 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd4027-837e-44b0-b295-ed3a3c201eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:12.634318 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd4027-837e-44b0-b295-ed3a3c201eed service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:12.644837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1096/2188] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:12.660199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de6e07-e58f-4d07-ac91-84168e270937 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:12.732158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de6e07-e58f-4d07-ac91-84168e270937 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:12.737320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:12.738706 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:12.740021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:12.740373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] PATH_INFO: `/v3/users/143411a246434a049f9400d2b25a7cde` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:12.742153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] RBAC: Authorizing `identity:delete_user(user_id=143411a246434a049f9400d2b25a7cde)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:12.744172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:13.009225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143411a246434a049f9400d2b25a7cde'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:13.022497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143411a246434a049f9400d2b25a7cde'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:13.107648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143411a246434a049f9400d2b25a7cde'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:13.120190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143411a246434a049f9400d2b25a7cde'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:13.120982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143411a246434a049f9400d2b25a7cde'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:13.128676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1093/2189] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:12 2022] DELETE /identity/v3/users/143411a246434a049f9400d2b25a7cde => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:13.133510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04796-aac1-4ce2-8d08-dd4f39324d3a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:13.134580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04796-aac1-4ce2-8d08-dd4f39324d3a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:13.134580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04796-aac1-4ce2-8d08-dd4f39324d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:13.155126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-99c04796-aac1-4ce2-8d08-dd4f39324d3a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:13.156430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-99c04796-aac1-4ce2-8d08-dd4f39324d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:13.230693 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1097/2190] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:13.246807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:13.248547 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:13.348868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c254b9-2ddc-4677-aa3a-c1b80e59168e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:13.356548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a5357-1192-4ba1-ba8d-f451372e465f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:13.357372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a5357-1192-4ba1-ba8d-f451372e465f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:13.357692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a5357-1192-4ba1-ba8d-f451372e465f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:13.357970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a5357-1192-4ba1-ba8d-f451372e465f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:13.368415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a5357-1192-4ba1-ba8d-f451372e465f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:13.369896 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a5357-1192-4ba1-ba8d-f451372e465f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:13.382343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1094/2191] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:13.884282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c04796-aac1-4ce2-8d08-dd4f39324d3a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:13.885795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-99c04796-aac1-4ce2-8d08-dd4f39324d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:13.899932 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c04796-aac1-4ce2-8d08-dd4f39324d3a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:13.904720 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:13.905637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:13.905922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:13.906199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] PATH_INFO: `/v3/projects/fc424635b0cb4cb9ba8303cdbeee1eea` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:13.908171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc424635b0cb4cb9ba8303cdbeee1eea)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:13.911104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:14.082667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc424635b0cb4cb9ba8303cdbeee1eea', 'request_id': 'req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:14.151329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc424635b0cb4cb9ba8303cdbeee1eea', 'request_id': 'req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:14.158197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc424635b0cb4cb9ba8303cdbeee1eea', 'request_id': 'req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:14.169249 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] The token cache is being invalidate because project fc424635b0cb4cb9ba8303cdbeee1eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:14.169537 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:14.170276 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c53259e3-eaa1-4dea-a2e7-7b41db4fd7a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:14.171837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1098/2192] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:13 2022] DELETE /identity/v3/projects/fc424635b0cb4cb9ba8303cdbeee1eea => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:14.176929 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3bef9-f239-42da-855d-b20b1b7cb240 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:14.177412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3bef9-f239-42da-855d-b20b1b7cb240 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:14.177502 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3bef9-f239-42da-855d-b20b1b7cb240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:14.196447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6de3bef9-f239-42da-855d-b20b1b7cb240 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:14.197695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6de3bef9-f239-42da-855d-b20b1b7cb240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:14.256306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1095/2193] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:14.264213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d047e8-d556-4ee9-84bc-f174580a98fa None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:14.264509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d047e8-d556-4ee9-84bc-f174580a98fa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:14.264919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d047e8-d556-4ee9-84bc-f174580a98fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:14.290899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b5d047e8-d556-4ee9-84bc-f174580a98fa None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:14.290899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b5d047e8-d556-4ee9-84bc-f174580a98fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:14.295680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1099/2194] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:14.301295 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3bef9-f239-42da-855d-b20b1b7cb240 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:14.311047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3bef9-f239-42da-855d-b20b1b7cb240 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:14.316821 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab666f-279c-4274-9d80-03681c5f61f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:14.317492 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab666f-279c-4274-9d80-03681c5f61f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:14.319026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab666f-279c-4274-9d80-03681c5f61f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:14.319371 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab666f-279c-4274-9d80-03681c5f61f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:14.320116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab666f-279c-4274-9d80-03681c5f61f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:27:14.320526 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab666f-279c-4274-9d80-03681c5f61f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:14.327052 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab666f-279c-4274-9d80-03681c5f61f9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:14.340124 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1096/2195] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:27:14.344793 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d047e8-d556-4ee9-84bc-f174580a98fa None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:14.355017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d047e8-d556-4ee9-84bc-f174580a98fa None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:14.360831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81187b-d150-436e-899a-29267c953b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:14.361626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81187b-d150-436e-899a-29267c953b09 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:14.371077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81187b-d150-436e-899a-29267c953b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:14.371077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81187b-d150-436e-899a-29267c953b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:14.371077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81187b-d150-436e-899a-29267c953b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:14.371077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81187b-d150-436e-899a-29267c953b09 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:14.491624 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1100/2196] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:14 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:14.495793 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab666f-279c-4274-9d80-03681c5f61f9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:14.506676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab666f-279c-4274-9d80-03681c5f61f9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:14.562314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731d75-7c82-4c99-bb8b-5f03b32a3b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:14.562985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731d75-7c82-4c99-bb8b-5f03b32a3b4b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:14.563272 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731d75-7c82-4c99-bb8b-5f03b32a3b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:14.564251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731d75-7c82-4c99-bb8b-5f03b32a3b4b admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:14.564990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05731d75-7c82-4c99-bb8b-5f03b32a3b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:14.567151 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05731d75-7c82-4c99-bb8b-5f03b32a3b4b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:14.712913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1097/2197] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:14 2022] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:14.717146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81187b-d150-436e-899a-29267c953b09 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:14.727886 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81187b-d150-436e-899a-29267c953b09 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:14.732460 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba3764-acfe-4da9-be49-01eb16109989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:14.733144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3764-acfe-4da9-be49-01eb16109989 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:14.733430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3764-acfe-4da9-be49-01eb16109989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:14.733707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3764-acfe-4da9-be49-01eb16109989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:14.734444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba3764-acfe-4da9-be49-01eb16109989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:14.736994 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba3764-acfe-4da9-be49-01eb16109989 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:14.747075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1101/2198] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:14.751968 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731d75-7c82-4c99-bb8b-5f03b32a3b4b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:14.761981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731d75-7c82-4c99-bb8b-5f03b32a3b4b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:14.766810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ff2c0-1253-4133-8a32-8d4bd4efd7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:14.767582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ff2c0-1253-4133-8a32-8d4bd4efd7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:14.767871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ff2c0-1253-4133-8a32-8d4bd4efd7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:14.768184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ff2c0-1253-4133-8a32-8d4bd4efd7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:14.768927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ff2c0-1253-4133-8a32-8d4bd4efd7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:14.770583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ff2c0-1253-4133-8a32-8d4bd4efd7b7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:14.780885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1098/2199] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:14.785722 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba3764-acfe-4da9-be49-01eb16109989 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:14.795442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba3764-acfe-4da9-be49-01eb16109989 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:14.800802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ac452-d9aa-4ce4-b0cb-74947052f4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:14.801697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ac452-d9aa-4ce4-b0cb-74947052f4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:14.801980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ac452-d9aa-4ce4-b0cb-74947052f4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:14.802256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ac452-d9aa-4ce4-b0cb-74947052f4fa admin admin] PATH_INFO: `/v3/projects/6311e2d40ee1421aa407b78e9941c7ac/users/a95c9e197c83492a8a841660706198cf/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:14.816943 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ac452-d9aa-4ce4-b0cb-74947052f4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6311e2d40ee1421aa407b78e9941c7ac, user_id=a95c9e197c83492a8a841660706198cf, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:14.819635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ac452-d9aa-4ce4-b0cb-74947052f4fa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:14.918798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1102/2200] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:14 2022] PUT /identity/v3/projects/6311e2d40ee1421aa407b78e9941c7ac/users/a95c9e197c83492a8a841660706198cf/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:14.930105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad15b7a-691b-4dd3-aeb7-de569089c051 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:14.930395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad15b7a-691b-4dd3-aeb7-de569089c051 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:14.930673 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad15b7a-691b-4dd3-aeb7-de569089c051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:14.957960 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cad15b7a-691b-4dd3-aeb7-de569089c051 None None] MFA Rules not processed for user `a95c9e197c83492a8a841660706198cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:14.959209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cad15b7a-691b-4dd3-aeb7-de569089c051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:15.022871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1099/2201] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:15.034789 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ac452-d9aa-4ce4-b0cb-74947052f4fa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:15.036602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-715ac452-d9aa-4ce4-b0cb-74947052f4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:15.092289 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ac452-d9aa-4ce4-b0cb-74947052f4fa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:15.097527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c1bb6-1ce1-4a1f-9fba-1c8412a3217f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef8bbd229c488d97f167c810bc7cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:15.097527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1bb6-1ce1-4a1f-9fba-1c8412a3217f service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:15.097777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1bb6-1ce1-4a1f-9fba-1c8412a3217f service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:15.097892 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1bb6-1ce1-4a1f-9fba-1c8412a3217f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:15.106156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c1bb6-1ce1-4a1f-9fba-1c8412a3217f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:15.107587 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c1bb6-1ce1-4a1f-9fba-1c8412a3217f service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:15.116274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1103/2202] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:20.473485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa594f-b192-4871-8c4a-b40161df4271 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:20.474007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa594f-b192-4871-8c4a-b40161df4271 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:20.474088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa594f-b192-4871-8c4a-b40161df4271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:20.506667 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d7aa594f-b192-4871-8c4a-b40161df4271 None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:20.507875 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d7aa594f-b192-4871-8c4a-b40161df4271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:20.591731 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1100/2203] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:27:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:20.640041 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c1bb6-1ce1-4a1f-9fba-1c8412a3217f service glance] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:20.642173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-978c1bb6-1ce1-4a1f-9fba-1c8412a3217f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:20.743066 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c1bb6-1ce1-4a1f-9fba-1c8412a3217f service glance] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:20.748186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b304adb-ce15-4562-92f3-16a82f20bfb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:20.748826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b304adb-ce15-4562-92f3-16a82f20bfb3 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:20.749142 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b304adb-ce15-4562-92f3-16a82f20bfb3 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:20.749415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b304adb-ce15-4562-92f3-16a82f20bfb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:20.758437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b304adb-ce15-4562-92f3-16a82f20bfb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:20.760015 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b304adb-ce15-4562-92f3-16a82f20bfb3 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:20.768739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1104/2204] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:27:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 14:27:21.956243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0d20-524a-4b61-928b-6f7efce90c01 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:21.956693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0d20-524a-4b61-928b-6f7efce90c01 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:21.956833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0d20-524a-4b61-928b-6f7efce90c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:21.975951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5f0b0d20-524a-4b61-928b-6f7efce90c01 None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:21.977277 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5f0b0d20-524a-4b61-928b-6f7efce90c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:21.991979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1101/2205] 10.222.0.61 () {58 vars in 967 bytes} [Tue Apr 12 14:27:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:21.998345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b304adb-ce15-4562-92f3-16a82f20bfb3 service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:22.008602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b304adb-ce15-4562-92f3-16a82f20bfb3 service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:22.013951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73badb0a-6a60-4b51-814f-cc22eb3e5ac4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:22.014589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73badb0a-6a60-4b51-814f-cc22eb3e5ac4 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:22.014870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73badb0a-6a60-4b51-814f-cc22eb3e5ac4 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:22.015143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73badb0a-6a60-4b51-814f-cc22eb3e5ac4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:22.024294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73badb0a-6a60-4b51-814f-cc22eb3e5ac4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:22.025898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73badb0a-6a60-4b51-814f-cc22eb3e5ac4 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:22.043746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1105/2206] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:27:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:27:22.912881 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db138fa-ac12-4a1b-a536-be0e1de461cd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:22.913203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db138fa-ac12-4a1b-a536-be0e1de461cd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:22.913498 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db138fa-ac12-4a1b-a536-be0e1de461cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:22.931902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4db138fa-ac12-4a1b-a536-be0e1de461cd None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:22.933161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4db138fa-ac12-4a1b-a536-be0e1de461cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:22.940509 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1102/2207] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:22.952684 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73badb0a-6a60-4b51-814f-cc22eb3e5ac4 service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:22.964047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73badb0a-6a60-4b51-814f-cc22eb3e5ac4 service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:22.969654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdb550-c952-4d2d-87df-2f31a8794a46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:22.971145 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdb550-c952-4d2d-87df-2f31a8794a46 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:22.971442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdb550-c952-4d2d-87df-2f31a8794a46 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:22.971717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdb550-c952-4d2d-87df-2f31a8794a46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:22.980674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdb550-c952-4d2d-87df-2f31a8794a46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:22.982276 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdb550-c952-4d2d-87df-2f31a8794a46 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:22.991301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1106/2208] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:27:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:27:23.443605 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db138fa-ac12-4a1b-a536-be0e1de461cd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:23.445178 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4db138fa-ac12-4a1b-a536-be0e1de461cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:23.558626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db138fa-ac12-4a1b-a536-be0e1de461cd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:23.563910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:23.564543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:23.564823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:23.565143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] PATH_INFO: `/v3/users/3442c1e1c9214ed69ae4211fcb7d7c15` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:23.567179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3442c1e1c9214ed69ae4211fcb7d7c15)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:23.569348 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:23.713216 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed74ec-4371-413d-9823-748b3569d2a2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:23.713679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed74ec-4371-413d-9823-748b3569d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:23.713766 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed74ec-4371-413d-9823-748b3569d2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:23.731117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ceed74ec-4371-413d-9823-748b3569d2a2 None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:23.732296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ceed74ec-4371-413d-9823-748b3569d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:23.740804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1107/2209] 10.222.0.61 () {58 vars in 967 bytes} [Tue Apr 12 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:23.753825 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed74ec-4371-413d-9823-748b3569d2a2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:23.765767 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed74ec-4371-413d-9823-748b3569d2a2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:23.772453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68152f53-e7f9-48a0-8d76-9aa22ee2d09f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:23.773188 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68152f53-e7f9-48a0-8d76-9aa22ee2d09f service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:23.773483 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68152f53-e7f9-48a0-8d76-9aa22ee2d09f service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:23.773753 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68152f53-e7f9-48a0-8d76-9aa22ee2d09f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:23.782929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68152f53-e7f9-48a0-8d76-9aa22ee2d09f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:23.784508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68152f53-e7f9-48a0-8d76-9aa22ee2d09f service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:23.793715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1108/2210] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:27:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 14:27:23.817590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3442c1e1c9214ed69ae4211fcb7d7c15'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:23.844849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3442c1e1c9214ed69ae4211fcb7d7c15'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:23.951519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3442c1e1c9214ed69ae4211fcb7d7c15'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:23.959982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3442c1e1c9214ed69ae4211fcb7d7c15'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:23.960671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3442c1e1c9214ed69ae4211fcb7d7c15'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:23.966760 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1103/2211] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:23 2022] DELETE /identity/v3/users/3442c1e1c9214ed69ae4211fcb7d7c15 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:23.971390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6da8fa-7705-4771-9ae1-1658e054a88a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:23.971690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6da8fa-7705-4771-9ae1-1658e054a88a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:23.972001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6da8fa-7705-4771-9ae1-1658e054a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:24.007412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5a6da8fa-7705-4771-9ae1-1658e054a88a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:24.008703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5a6da8fa-7705-4771-9ae1-1658e054a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:24.081723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1109/2212] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:24.083892 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:24.085412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:24.178110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57244a-ae04-4a23-9714-8727a1749ed6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:24.181155 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcea80-9230-4510-90f7-f109883bc12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:24.181829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcea80-9230-4510-90f7-f109883bc12e service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:24.182117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcea80-9230-4510-90f7-f109883bc12e service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:24.185743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcea80-9230-4510-90f7-f109883bc12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:24.193047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcea80-9230-4510-90f7-f109883bc12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:24.194477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcea80-9230-4510-90f7-f109883bc12e service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:24.205746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1104/2213] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:24.749219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6da8fa-7705-4771-9ae1-1658e054a88a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:24.750965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5a6da8fa-7705-4771-9ae1-1658e054a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:24.773792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6da8fa-7705-4771-9ae1-1658e054a88a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:24.779184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:24.780061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:24.782963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:24.782963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] PATH_INFO: `/v3/projects/acc6a560caaf472aa26af3f89cdb833c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:24.782963 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc6a560caaf472aa26af3f89cdb833c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:24.785280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:24.958388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc6a560caaf472aa26af3f89cdb833c', 'request_id': 'req-1ebbbd37-cf34-4b89-8508-bbe842544c39'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:25.164182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc6a560caaf472aa26af3f89cdb833c', 'request_id': 'req-1ebbbd37-cf34-4b89-8508-bbe842544c39'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:25.170784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc6a560caaf472aa26af3f89cdb833c', 'request_id': 'req-1ebbbd37-cf34-4b89-8508-bbe842544c39'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:25.182745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] The token cache is being invalidate because project acc6a560caaf472aa26af3f89cdb833c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:25.183044 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:25.183772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1ebbbd37-cf34-4b89-8508-bbe842544c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:25.185791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1110/2214] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:24 2022] DELETE /identity/v3/projects/acc6a560caaf472aa26af3f89cdb833c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:25.191680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8f04-de50-49c4-91e7-d1a564e9d3a3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:25.192172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8f04-de50-49c4-91e7-d1a564e9d3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:25.192526 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8f04-de50-49c4-91e7-d1a564e9d3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:25.235543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d4aa8f04-de50-49c4-91e7-d1a564e9d3a3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:25.247065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d4aa8f04-de50-49c4-91e7-d1a564e9d3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:25.337020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1105/2215] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:25.338807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddb121-3828-4a0d-a78f-31f8618f5f66 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:25.339101 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddb121-3828-4a0d-a78f-31f8618f5f66 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:25.339375 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddb121-3828-4a0d-a78f-31f8618f5f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:25.358740 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ecddb121-3828-4a0d-a78f-31f8618f5f66 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:25.359988 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ecddb121-3828-4a0d-a78f-31f8618f5f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:25.370565 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1111/2216] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:25.376788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa8f04-de50-49c4-91e7-d1a564e9d3a3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:25.386946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa8f04-de50-49c4-91e7-d1a564e9d3a3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:25.394960 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7affc-b50f-4789-afe2-a1823d2ed821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:25.397010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7affc-b50f-4789-afe2-a1823d2ed821 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:25.397297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7affc-b50f-4789-afe2-a1823d2ed821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:25.397572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7affc-b50f-4789-afe2-a1823d2ed821 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:25.398308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7affc-b50f-4789-afe2-a1823d2ed821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:27:25.398930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7affc-b50f-4789-afe2-a1823d2ed821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:25.400796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7affc-b50f-4789-afe2-a1823d2ed821 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:25.415408 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1106/2217] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:27:25.423048 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddb121-3828-4a0d-a78f-31f8618f5f66 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:25.430189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddb121-3828-4a0d-a78f-31f8618f5f66 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:25.439030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15202d-a2c1-454d-a385-a334d921d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:25.439030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15202d-a2c1-454d-a385-a334d921d537 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:25.439030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15202d-a2c1-454d-a385-a334d921d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:25.439030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15202d-a2c1-454d-a385-a334d921d537 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:25.439403 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15202d-a2c1-454d-a385-a334d921d537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:25.439403 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15202d-a2c1-454d-a385-a334d921d537 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:25.607639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1112/2218] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:25 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:25.612713 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7affc-b50f-4789-afe2-a1823d2ed821 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:25.623139 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7affc-b50f-4789-afe2-a1823d2ed821 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:25.693238 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd8c11-32d7-40c4-a113-2ee14068078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:25.693940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd8c11-32d7-40c4-a113-2ee14068078e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:25.694223 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd8c11-32d7-40c4-a113-2ee14068078e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:25.694502 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd8c11-32d7-40c4-a113-2ee14068078e admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:25.695736 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd8c11-32d7-40c4-a113-2ee14068078e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:25.697173 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd8c11-32d7-40c4-a113-2ee14068078e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:25.805403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1107/2219] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:25 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:25.809575 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15202d-a2c1-454d-a385-a334d921d537 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:25.821031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15202d-a2c1-454d-a385-a334d921d537 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:25.825705 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac0a1c-03a7-4ba1-b85c-c6faf91792fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:25.826362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac0a1c-03a7-4ba1-b85c-c6faf91792fa admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:25.826646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac0a1c-03a7-4ba1-b85c-c6faf91792fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:25.826925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac0a1c-03a7-4ba1-b85c-c6faf91792fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:25.827643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac0a1c-03a7-4ba1-b85c-c6faf91792fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:25.829415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac0a1c-03a7-4ba1-b85c-c6faf91792fa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:25.841723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1113/2220] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:25.845766 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd8c11-32d7-40c4-a113-2ee14068078e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:25.856811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd8c11-32d7-40c4-a113-2ee14068078e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:25.862225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39050f93-0244-4d97-b122-6bce9fa0d4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:25.862884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050f93-0244-4d97-b122-6bce9fa0d4ec admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:25.863165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050f93-0244-4d97-b122-6bce9fa0d4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:25.863438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050f93-0244-4d97-b122-6bce9fa0d4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:25.864216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39050f93-0244-4d97-b122-6bce9fa0d4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:25.865888 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39050f93-0244-4d97-b122-6bce9fa0d4ec admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:25.877962 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1108/2221] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:25.882437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac0a1c-03a7-4ba1-b85c-c6faf91792fa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:25.892481 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac0a1c-03a7-4ba1-b85c-c6faf91792fa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:25.897195 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95548f35-7d5e-467e-9259-7232dc9859ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:25.898076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95548f35-7d5e-467e-9259-7232dc9859ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:25.898342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95548f35-7d5e-467e-9259-7232dc9859ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:25.898610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95548f35-7d5e-467e-9259-7232dc9859ac admin admin] PATH_INFO: `/v3/projects/eaee8db19f7b4475b080ade0ba54be2b/users/6a2934fdff02445f9a4d4a37caebc727/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:25.913787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95548f35-7d5e-467e-9259-7232dc9859ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaee8db19f7b4475b080ade0ba54be2b, user_id=6a2934fdff02445f9a4d4a37caebc727, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:25.916455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95548f35-7d5e-467e-9259-7232dc9859ac admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:26.005812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1114/2222] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:25 2022] PUT /identity/v3/projects/eaee8db19f7b4475b080ade0ba54be2b/users/6a2934fdff02445f9a4d4a37caebc727/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:26.015274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726a5e1-3f14-42a6-b4ab-09662e63dbc6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:26.015564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726a5e1-3f14-42a6-b4ab-09662e63dbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:26.015845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726a5e1-3f14-42a6-b4ab-09662e63dbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:26.044667 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c726a5e1-3f14-42a6-b4ab-09662e63dbc6 None None] MFA Rules not processed for user `6a2934fdff02445f9a4d4a37caebc727`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:26.046886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c726a5e1-3f14-42a6-b4ab-09662e63dbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:26.116584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1109/2223] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:26.121169 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95548f35-7d5e-467e-9259-7232dc9859ac admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:26.184910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95548f35-7d5e-467e-9259-7232dc9859ac admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:26.189440 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98408274-f69c-47b5-87d0-d3315deab97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:26.190155 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408274-f69c-47b5-87d0-d3315deab97e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:26.190385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408274-f69c-47b5-87d0-d3315deab97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:26.190655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408274-f69c-47b5-87d0-d3315deab97e admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:26.191643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98408274-f69c-47b5-87d0-d3315deab97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:26.193613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98408274-f69c-47b5-87d0-d3315deab97e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:26.360627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1115/2224] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:26 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:27:26.376867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726a5e1-3f14-42a6-b4ab-09662e63dbc6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:26.388324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726a5e1-3f14-42a6-b4ab-09662e63dbc6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:26.450936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521886f0-68ea-483c-9829-03c57be7008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:26.451671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521886f0-68ea-483c-9829-03c57be7008d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:26.451956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521886f0-68ea-483c-9829-03c57be7008d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:26.452234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521886f0-68ea-483c-9829-03c57be7008d admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:26.452932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521886f0-68ea-483c-9829-03c57be7008d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:26.455740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521886f0-68ea-483c-9829-03c57be7008d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:26.576303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1110/2225] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:26 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:26.584625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98408274-f69c-47b5-87d0-d3315deab97e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:26.597869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98408274-f69c-47b5-87d0-d3315deab97e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:26.602556 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7b5b3-552c-44f0-93ba-063147a5f09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:26.603221 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7b5b3-552c-44f0-93ba-063147a5f09e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:26.603535 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7b5b3-552c-44f0-93ba-063147a5f09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:26.603810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7b5b3-552c-44f0-93ba-063147a5f09e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:26.604536 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7b5b3-552c-44f0-93ba-063147a5f09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:26.606180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7b5b3-552c-44f0-93ba-063147a5f09e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:26.617339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1116/2226] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:26.621352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521886f0-68ea-483c-9829-03c57be7008d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:26.631528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521886f0-68ea-483c-9829-03c57be7008d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:26.636212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd87840-5568-44ee-bba0-12ea0f86da39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:26.636870 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd87840-5568-44ee-bba0-12ea0f86da39 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:26.637194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd87840-5568-44ee-bba0-12ea0f86da39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:26.637476 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd87840-5568-44ee-bba0-12ea0f86da39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:26.638203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd87840-5568-44ee-bba0-12ea0f86da39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:26.639795 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd87840-5568-44ee-bba0-12ea0f86da39 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:26.650190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1111/2227] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:26.654952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7b5b3-552c-44f0-93ba-063147a5f09e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:26.666675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7b5b3-552c-44f0-93ba-063147a5f09e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:26.672032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3bef6-b978-44fa-88f7-b9748967dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:26.673159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3bef6-b978-44fa-88f7-b9748967dadd admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:26.673590 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3bef6-b978-44fa-88f7-b9748967dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:26.673983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3bef6-b978-44fa-88f7-b9748967dadd admin admin] PATH_INFO: `/v3/projects/8b521502dd2c4d01bef4b82ed469fa75/users/7fab7a9e61e349189f175f3df5e88635/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:26.689199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3bef6-b978-44fa-88f7-b9748967dadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b521502dd2c4d01bef4b82ed469fa75, user_id=7fab7a9e61e349189f175f3df5e88635, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:26.692087 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3bef6-b978-44fa-88f7-b9748967dadd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:26.839937 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1117/2228] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:26 2022] PUT /identity/v3/projects/8b521502dd2c4d01bef4b82ed469fa75/users/7fab7a9e61e349189f175f3df5e88635/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:26.856161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd6063-6dff-4414-9c33-713f21664881 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:26.856536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd6063-6dff-4414-9c33-713f21664881 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:26.856849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd6063-6dff-4414-9c33-713f21664881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:26.887968 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9cbd6063-6dff-4414-9c33-713f21664881 None None] MFA Rules not processed for user `7fab7a9e61e349189f175f3df5e88635`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:26.889225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9cbd6063-6dff-4414-9c33-713f21664881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:26.930877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3bef6-b978-44fa-88f7-b9748967dadd admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:26.932638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1ae3bef6-b978-44fa-88f7-b9748967dadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:26.961248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1112/2229] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:26.965657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd6063-6dff-4414-9c33-713f21664881 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:26.999723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3bef6-b978-44fa-88f7-b9748967dadd admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:27.006424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea0638-4a2c-4bf7-887e-46ae03be379e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:27.010573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea0638-4a2c-4bf7-887e-46ae03be379e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:27.010573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea0638-4a2c-4bf7-887e-46ae03be379e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:27.010573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea0638-4a2c-4bf7-887e-46ae03be379e admin admin] PATH_INFO: `/v3/users/762d950c213a4794aca9afbaa82f2a69` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:27.010573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea0638-4a2c-4bf7-887e-46ae03be379e admin admin] RBAC: Authorizing `identity:delete_user(user_id=762d950c213a4794aca9afbaa82f2a69)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:27.011106 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea0638-4a2c-4bf7-887e-46ae03be379e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:27.032976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd6063-6dff-4414-9c33-713f21664881 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:27.037885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dbc64-8f15-4265-850e-9ee80f0494f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:27.038555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dbc64-8f15-4265-850e-9ee80f0494f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:27.038842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dbc64-8f15-4265-850e-9ee80f0494f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:27.039122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dbc64-8f15-4265-850e-9ee80f0494f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:27.039818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dbc64-8f15-4265-850e-9ee80f0494f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:27.041829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dbc64-8f15-4265-850e-9ee80f0494f7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:27.165385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1113/2230] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:26 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:27:27.169471 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dbc64-8f15-4265-850e-9ee80f0494f7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:27.231933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dbc64-8f15-4265-850e-9ee80f0494f7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:27.237522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e77745-3f7d-4c31-96cb-70f899454a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:27.238194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77745-3f7d-4c31-96cb-70f899454a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:27.238477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77745-3f7d-4c31-96cb-70f899454a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:27.238752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77745-3f7d-4c31-96cb-70f899454a8a admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:27.239441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e77745-3f7d-4c31-96cb-70f899454a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:27.241396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e77745-3f7d-4c31-96cb-70f899454a8a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:27.259791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5fea0638-4a2c-4bf7-887e-46ae03be379e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762d950c213a4794aca9afbaa82f2a69'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:27.271308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5fea0638-4a2c-4bf7-887e-46ae03be379e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762d950c213a4794aca9afbaa82f2a69'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:27.271976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5fea0638-4a2c-4bf7-887e-46ae03be379e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762d950c213a4794aca9afbaa82f2a69'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:27.278962 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5fea0638-4a2c-4bf7-887e-46ae03be379e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762d950c213a4794aca9afbaa82f2a69'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:27.279642 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5fea0638-4a2c-4bf7-887e-46ae03be379e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762d950c213a4794aca9afbaa82f2a69'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:27.355917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1114/2231] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:27 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:27:27.357304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e77745-3f7d-4c31-96cb-70f899454a8a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:27.358966 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a1e77745-3f7d-4c31-96cb-70f899454a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:27.371665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e77745-3f7d-4c31-96cb-70f899454a8a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:27.381050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f93c26-de84-41ca-86c8-7f7ec3cb6887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:27.381050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f93c26-de84-41ca-86c8-7f7ec3cb6887 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:27.381050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f93c26-de84-41ca-86c8-7f7ec3cb6887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:27.381050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f93c26-de84-41ca-86c8-7f7ec3cb6887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:27.382019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f93c26-de84-41ca-86c8-7f7ec3cb6887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:27.382019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f93c26-de84-41ca-86c8-7f7ec3cb6887 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:27.391377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1115/2232] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:27:27.397998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f93c26-de84-41ca-86c8-7f7ec3cb6887 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:27.409912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f93c26-de84-41ca-86c8-7f7ec3cb6887 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:27.415372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fbd23-ec72-45cb-bb7c-62ce43e653df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:27.416300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fbd23-ec72-45cb-bb7c-62ce43e653df admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:27.416436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1118/2233] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:26 2022] DELETE /identity/v3/users/762d950c213a4794aca9afbaa82f2a69 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:27.420021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fbd23-ec72-45cb-bb7c-62ce43e653df admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:27.420021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fbd23-ec72-45cb-bb7c-62ce43e653df admin admin] PATH_INFO: `/v3/projects/e7415510c9194db1a393315d51406d75/users/9aee468da63544e1bf28572fcbe06654/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:27.421263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6f49-2de7-4efe-83ef-d4b0fa46f255 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:27.421549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6f49-2de7-4efe-83ef-d4b0fa46f255 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:27.422132 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6f49-2de7-4efe-83ef-d4b0fa46f255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:27.435820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fbd23-ec72-45cb-bb7c-62ce43e653df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7415510c9194db1a393315d51406d75, user_id=9aee468da63544e1bf28572fcbe06654, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:27.438944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fbd23-ec72-45cb-bb7c-62ce43e653df admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:27.444786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-94ec6f49-2de7-4efe-83ef-d4b0fa46f255 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:27.446057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-94ec6f49-2de7-4efe-83ef-d4b0fa46f255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:27.508424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1119/2234] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:27.517746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec6f49-2de7-4efe-83ef-d4b0fa46f255 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:27.519184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-94ec6f49-2de7-4efe-83ef-d4b0fa46f255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:27.524746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1116/2235] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:27 2022] PUT /identity/v3/projects/e7415510c9194db1a393315d51406d75/users/9aee468da63544e1bf28572fcbe06654/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:27.529478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fbd23-ec72-45cb-bb7c-62ce43e653df admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:27.580304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec6f49-2de7-4efe-83ef-d4b0fa46f255 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:27.595889 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fbd23-ec72-45cb-bb7c-62ce43e653df admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:27.601355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b9a10-8fe6-4ab3-9133-87725a170699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:27.602041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b9a10-8fe6-4ab3-9133-87725a170699 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:27.602324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b9a10-8fe6-4ab3-9133-87725a170699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:27.602605 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b9a10-8fe6-4ab3-9133-87725a170699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:27.603829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b9a10-8fe6-4ab3-9133-87725a170699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:27.605302 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b9a10-8fe6-4ab3-9133-87725a170699 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:27.616400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1117/2236] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:27:27.620585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b9a10-8fe6-4ab3-9133-87725a170699 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:27.631340 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b9a10-8fe6-4ab3-9133-87725a170699 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:27.636261 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d09ff5-44c6-49e1-b666-b99ec28543c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:27.637293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d09ff5-44c6-49e1-b666-b99ec28543c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:27.637696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d09ff5-44c6-49e1-b666-b99ec28543c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:27.638037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d09ff5-44c6-49e1-b666-b99ec28543c1 admin admin] PATH_INFO: `/v3/projects/e7415510c9194db1a393315d51406d75/users/9aee468da63544e1bf28572fcbe06654/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:27.638158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6ad0d-15f6-4a7d-8a99-06d3a23ba84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:27.638799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6ad0d-15f6-4a7d-8a99-06d3a23ba84f service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:27.639085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6ad0d-15f6-4a7d-8a99-06d3a23ba84f service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:27.639357 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6ad0d-15f6-4a7d-8a99-06d3a23ba84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:27.640615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d09ff5-44c6-49e1-b666-b99ec28543c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7415510c9194db1a393315d51406d75, user_id=9aee468da63544e1bf28572fcbe06654, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:27.643462 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d09ff5-44c6-49e1-b666-b99ec28543c1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:27.649760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6ad0d-15f6-4a7d-8a99-06d3a23ba84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:27.651193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6ad0d-15f6-4a7d-8a99-06d3a23ba84f service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:27.654486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1118/2237] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:27 2022] PUT /identity/v3/projects/e7415510c9194db1a393315d51406d75/users/9aee468da63544e1bf28572fcbe06654/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:27.662665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1120/2238] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:27.666627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dadb6-071d-4b1a-9b56-e562508bd4ba None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:27.666842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dadb6-071d-4b1a-9b56-e562508bd4ba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:27.667050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dadb6-071d-4b1a-9b56-e562508bd4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:27.698624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d66dadb6-071d-4b1a-9b56-e562508bd4ba None None] MFA Rules not processed for user `9aee468da63544e1bf28572fcbe06654`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:27.699956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d66dadb6-071d-4b1a-9b56-e562508bd4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:27.774318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1119/2239] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:27.786564 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6ad0d-15f6-4a7d-8a99-06d3a23ba84f service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:27.788175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b8a6ad0d-15f6-4a7d-8a99-06d3a23ba84f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:27.849209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6ad0d-15f6-4a7d-8a99-06d3a23ba84f service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:27.901290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a2da2-c5fd-495d-95be-747e4bce6c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:27.902332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a2da2-c5fd-495d-95be-747e4bce6c9f service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:27.902832 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a2da2-c5fd-495d-95be-747e4bce6c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:27.903319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a2da2-c5fd-495d-95be-747e4bce6c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:27.906111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-388a2da2-c5fd-495d-95be-747e4bce6c9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:27.926767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dadb6-071d-4b1a-9b56-e562508bd4ba None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:27.928192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d66dadb6-071d-4b1a-9b56-e562508bd4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:27.984757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a2da2-c5fd-495d-95be-747e4bce6c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:27.986276 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a2da2-c5fd-495d-95be-747e4bce6c9f service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:27.995869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1121/2240] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:28.017398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dadb6-071d-4b1a-9b56-e562508bd4ba None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:28.025063 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:28.026266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:28.026809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:28.027290 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] PATH_INFO: `/v3/projects/6d5c7c86d23b4beba850f169f412760d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:28.028698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5c7c86d23b4beba850f169f412760d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:28.031939 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:28.176398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5c7c86d23b4beba850f169f412760d', 'request_id': 'req-3b0f4ee4-a979-4129-9462-f16faa6528a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:28.255900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5c7c86d23b4beba850f169f412760d', 'request_id': 'req-3b0f4ee4-a979-4129-9462-f16faa6528a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:28.262880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5c7c86d23b4beba850f169f412760d', 'request_id': 'req-3b0f4ee4-a979-4129-9462-f16faa6528a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:28.273874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] The token cache is being invalidate because project 6d5c7c86d23b4beba850f169f412760d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:28.274163 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:28.274798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3b0f4ee4-a979-4129-9462-f16faa6528a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:28.276319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1120/2241] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:27 2022] DELETE /identity/v3/projects/6d5c7c86d23b4beba850f169f412760d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:28.281133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a507b9f-a742-44b8-8bbe-645a88329834 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:28.281425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a507b9f-a742-44b8-8bbe-645a88329834 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:28.281703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a507b9f-a742-44b8-8bbe-645a88329834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:28.300503 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5a507b9f-a742-44b8-8bbe-645a88329834 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:28.301771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5a507b9f-a742-44b8-8bbe-645a88329834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:28.362685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1122/2242] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:28.370549 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff158-c454-415e-b6e8-e15359e4407a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:28.370842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff158-c454-415e-b6e8-e15359e4407a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:28.371123 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff158-c454-415e-b6e8-e15359e4407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:28.390519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c44ff158-c454-415e-b6e8-e15359e4407a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:28.392457 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c44ff158-c454-415e-b6e8-e15359e4407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:28.404341 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1121/2243] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:28.405511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a507b9f-a742-44b8-8bbe-645a88329834 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:28.416016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a507b9f-a742-44b8-8bbe-645a88329834 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:28.420806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334c838-552d-4fea-b083-d2bd00a97432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:28.421503 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334c838-552d-4fea-b083-d2bd00a97432 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:28.421784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334c838-552d-4fea-b083-d2bd00a97432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:28.422215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334c838-552d-4fea-b083-d2bd00a97432 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:28.422939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334c838-552d-4fea-b083-d2bd00a97432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:27:28.423250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334c838-552d-4fea-b083-d2bd00a97432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:28.424923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334c838-552d-4fea-b083-d2bd00a97432 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:28.441480 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1123/2244] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:27:28.444786 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ff158-c454-415e-b6e8-e15359e4407a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:28.454993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ff158-c454-415e-b6e8-e15359e4407a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:28.459868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b9fda-488f-4abc-b972-742523b42de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:28.460557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b9fda-488f-4abc-b972-742523b42de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:28.460842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b9fda-488f-4abc-b972-742523b42de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:28.461262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b9fda-488f-4abc-b972-742523b42de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:28.461963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b9fda-488f-4abc-b972-742523b42de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:28.463866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b9fda-488f-4abc-b972-742523b42de1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:28.726469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1122/2245] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:28 2022] POST /identity/v3/projects => generated 383 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:28.730466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334c838-552d-4fea-b083-d2bd00a97432 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:28.741047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334c838-552d-4fea-b083-d2bd00a97432 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:28.798976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c4b46-fd32-47f5-b600-e3012d04ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:28.799643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c4b46-fd32-47f5-b600-e3012d04ab85 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:28.799920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c4b46-fd32-47f5-b600-e3012d04ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:28.800193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c4b46-fd32-47f5-b600-e3012d04ab85 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:28.800894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c4b46-fd32-47f5-b600-e3012d04ab85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:28.802965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c4b46-fd32-47f5-b600-e3012d04ab85 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:28.925115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1124/2246] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:28 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:27:28.931480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b9fda-488f-4abc-b972-742523b42de1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:28.942626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b9fda-488f-4abc-b972-742523b42de1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:28.950406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00960-f389-45c5-b6b8-73e885cb5e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:28.950932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00960-f389-45c5-b6b8-73e885cb5e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:28.951302 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00960-f389-45c5-b6b8-73e885cb5e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:28.951643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00960-f389-45c5-b6b8-73e885cb5e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:28.952516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d00960-f389-45c5-b6b8-73e885cb5e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:28.954696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d00960-f389-45c5-b6b8-73e885cb5e37 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:28.965955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1123/2247] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:28.970965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c4b46-fd32-47f5-b600-e3012d04ab85 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:28.980790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c4b46-fd32-47f5-b600-e3012d04ab85 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:28.986167 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362285b1-f09c-493e-833e-7a2d2c11fc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:28.986855 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362285b1-f09c-493e-833e-7a2d2c11fc8a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:28.987135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362285b1-f09c-493e-833e-7a2d2c11fc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:28.987407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362285b1-f09c-493e-833e-7a2d2c11fc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:28.988152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362285b1-f09c-493e-833e-7a2d2c11fc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:28.989773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362285b1-f09c-493e-833e-7a2d2c11fc8a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:29.000424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1125/2248] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:29.006419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00960-f389-45c5-b6b8-73e885cb5e37 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:29.016919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00960-f389-45c5-b6b8-73e885cb5e37 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:29.023117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc1bae-089d-4b9a-a562-53459303717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:29.023117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc1bae-089d-4b9a-a562-53459303717d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:29.023421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc1bae-089d-4b9a-a562-53459303717d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:29.025000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc1bae-089d-4b9a-a562-53459303717d admin admin] PATH_INFO: `/v3/projects/d09d16c1614c4715a121f402aeaa024f/users/fa49364b644f4beb9a1e9df859f20a8f/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:29.040599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc1bae-089d-4b9a-a562-53459303717d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09d16c1614c4715a121f402aeaa024f, user_id=fa49364b644f4beb9a1e9df859f20a8f, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:29.043292 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc1bae-089d-4b9a-a562-53459303717d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:29.159991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1124/2249] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:29 2022] PUT /identity/v3/projects/d09d16c1614c4715a121f402aeaa024f/users/fa49364b644f4beb9a1e9df859f20a8f/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:29.165166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b64e47-4f3a-4a87-95ab-fe60bdcdf69e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:29.165454 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b64e47-4f3a-4a87-95ab-fe60bdcdf69e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:29.165735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b64e47-4f3a-4a87-95ab-fe60bdcdf69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:29.183983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-05b64e47-4f3a-4a87-95ab-fe60bdcdf69e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:29.185213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-05b64e47-4f3a-4a87-95ab-fe60bdcdf69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:29.245962 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1126/2250] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:29.263815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc1bae-089d-4b9a-a562-53459303717d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:29.263815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-17bc1bae-089d-4b9a-a562-53459303717d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:29.314614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc1bae-089d-4b9a-a562-53459303717d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:29.318516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299a3bf-6798-4ac9-8767-1693220341bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:29.319150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299a3bf-6798-4ac9-8767-1693220341bc service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:29.319428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299a3bf-6798-4ac9-8767-1693220341bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:29.319700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299a3bf-6798-4ac9-8767-1693220341bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:29.328448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299a3bf-6798-4ac9-8767-1693220341bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:29.330426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299a3bf-6798-4ac9-8767-1693220341bc service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:29.339925 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1125/2251] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:30.392628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b64e47-4f3a-4a87-95ab-fe60bdcdf69e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:30.394156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-05b64e47-4f3a-4a87-95ab-fe60bdcdf69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:30.451863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b64e47-4f3a-4a87-95ab-fe60bdcdf69e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:30.455959 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a946381-fa6f-4ef5-a778-2a4bd97c3343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:30.456607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a946381-fa6f-4ef5-a778-2a4bd97c3343 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:30.456888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a946381-fa6f-4ef5-a778-2a4bd97c3343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:30.457187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a946381-fa6f-4ef5-a778-2a4bd97c3343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:30.458972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8a946381-fa6f-4ef5-a778-2a4bd97c3343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:30.522363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a946381-fa6f-4ef5-a778-2a4bd97c3343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:30.523682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a946381-fa6f-4ef5-a778-2a4bd97c3343 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:30.533365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1127/2252] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:31.037980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024e1e4-4c54-49b4-9635-4d3c555786ab None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:31.037980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024e1e4-4c54-49b4-9635-4d3c555786ab None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:31.037980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024e1e4-4c54-49b4-9635-4d3c555786ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:31.074177 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7024e1e4-4c54-49b4-9635-4d3c555786ab None None] MFA Rules not processed for user `fa49364b644f4beb9a1e9df859f20a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:31.075407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7024e1e4-4c54-49b4-9635-4d3c555786ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:31.145718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1126/2253] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:31.166170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a946381-fa6f-4ef5-a778-2a4bd97c3343 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:31.167604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8a946381-fa6f-4ef5-a778-2a4bd97c3343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:31.178752 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a946381-fa6f-4ef5-a778-2a4bd97c3343 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:31.182574 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdd43d-aae5-46cf-a2ed-77745c4b6527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:31.183218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdd43d-aae5-46cf-a2ed-77745c4b6527 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:31.183506 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdd43d-aae5-46cf-a2ed-77745c4b6527 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:31.183778 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdd43d-aae5-46cf-a2ed-77745c4b6527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:31.198541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdd43d-aae5-46cf-a2ed-77745c4b6527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:31.202321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdd43d-aae5-46cf-a2ed-77745c4b6527 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:31.208755 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1128/2254] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:32.510894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024e1e4-4c54-49b4-9635-4d3c555786ab None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:32.520755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024e1e4-4c54-49b4-9635-4d3c555786ab None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:32.524433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c75df-1c69-4c24-8d66-c58f4f3d6fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:32.525114 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c75df-1c69-4c24-8d66-c58f4f3d6fab service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:32.525400 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c75df-1c69-4c24-8d66-c58f4f3d6fab service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:32.525674 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c75df-1c69-4c24-8d66-c58f4f3d6fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:32.527539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ea8c75df-1c69-4c24-8d66-c58f4f3d6fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:32.592183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c75df-1c69-4c24-8d66-c58f4f3d6fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:32.593690 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c75df-1c69-4c24-8d66-c58f4f3d6fab service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:32.603460 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1127/2255] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:33.114720 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d26e6-df39-4896-ba50-16800eff51e4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:33.115224 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d26e6-df39-4896-ba50-16800eff51e4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:33.115381 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d26e6-df39-4896-ba50-16800eff51e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:33.132308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-729d26e6-df39-4896-ba50-16800eff51e4 None None] MFA Rules not processed for user `fa49364b644f4beb9a1e9df859f20a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:33.133484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-729d26e6-df39-4896-ba50-16800eff51e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:33.140406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1129/2256] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:42.140269 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c75df-1c69-4c24-8d66-c58f4f3d6fab service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:42.141794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ea8c75df-1c69-4c24-8d66-c58f4f3d6fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:42.156470 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c75df-1c69-4c24-8d66-c58f4f3d6fab service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:42.161816 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:42.163103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:42.163586 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:42.164927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] PATH_INFO: `/v3/users/6a2934fdff02445f9a4d4a37caebc727` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:42.170091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2934fdff02445f9a4d4a37caebc727)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:42.170091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:42.459020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2934fdff02445f9a4d4a37caebc727'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:42.471825 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2934fdff02445f9a4d4a37caebc727'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:42.575977 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2934fdff02445f9a4d4a37caebc727'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:42.588358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2934fdff02445f9a4d4a37caebc727'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:42.588358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2934fdff02445f9a4d4a37caebc727'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:42.590857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1128/2257] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:42 2022] DELETE /identity/v3/users/6a2934fdff02445f9a4d4a37caebc727 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:42.595992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64487c1d-ed96-43ab-b880-0c5245ea413f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:42.596510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64487c1d-ed96-43ab-b880-0c5245ea413f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:42.596701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64487c1d-ed96-43ab-b880-0c5245ea413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:42.617019 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-64487c1d-ed96-43ab-b880-0c5245ea413f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:42.618287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-64487c1d-ed96-43ab-b880-0c5245ea413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:42.688658 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1130/2258] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:42.698590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:42.700386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:42.783596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92584cce-76ab-42d8-afa1-14c4149508b9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:42.788626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d4d02-012b-4d68-a903-952320011c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:42.790361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4d02-012b-4d68-a903-952320011c17 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:42.791712 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4d02-012b-4d68-a903-952320011c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:42.792247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4d02-012b-4d68-a903-952320011c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:42.807117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d4d02-012b-4d68-a903-952320011c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:42.810045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d4d02-012b-4d68-a903-952320011c17 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:42.826718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1129/2259] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:27:43.421068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64487c1d-ed96-43ab-b880-0c5245ea413f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:43.421678 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-64487c1d-ed96-43ab-b880-0c5245ea413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:43.435279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64487c1d-ed96-43ab-b880-0c5245ea413f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:43.442284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:43.443504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:43.443857 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:43.444463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] PATH_INFO: `/v3/projects/eaee8db19f7b4475b080ade0ba54be2b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:43.445763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaee8db19f7b4475b080ade0ba54be2b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:43.448134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:43.687909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaee8db19f7b4475b080ade0ba54be2b', 'request_id': 'req-a3057081-93a3-44ab-b6cb-e4f504b647b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:43.794305 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaee8db19f7b4475b080ade0ba54be2b', 'request_id': 'req-a3057081-93a3-44ab-b6cb-e4f504b647b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:43.801468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaee8db19f7b4475b080ade0ba54be2b', 'request_id': 'req-a3057081-93a3-44ab-b6cb-e4f504b647b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:43.819317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] The token cache is being invalidate because project eaee8db19f7b4475b080ade0ba54be2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:43.819609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:43.820317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:43.821926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1131/2260] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:43 2022] DELETE /identity/v3/projects/eaee8db19f7b4475b080ade0ba54be2b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:43.826024 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d4d02-012b-4d68-a903-952320011c17 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:43.837192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d4d02-012b-4d68-a903-952320011c17 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:43.899429 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:43.900320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:43.900642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:43.901187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] PATH_INFO: `/v3/users/7fab7a9e61e349189f175f3df5e88635` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:43.902509 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fab7a9e61e349189f175f3df5e88635)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:43.904640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:44.218071 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fab7a9e61e349189f175f3df5e88635'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:44.231116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fab7a9e61e349189f175f3df5e88635'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:44.359171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fab7a9e61e349189f175f3df5e88635'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:44.366531 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fab7a9e61e349189f175f3df5e88635'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:44.367161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fab7a9e61e349189f175f3df5e88635'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:44.373447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1130/2261] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:43 2022] DELETE /identity/v3/users/7fab7a9e61e349189f175f3df5e88635 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:44.863374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:44.864898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:44.879983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3057081-93a3-44ab-b6cb-e4f504b647b6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:44.936246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:44.943322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:44.943322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:44.943322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] PATH_INFO: `/v3/projects/8b521502dd2c4d01bef4b82ed469fa75` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:44.943322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b521502dd2c4d01bef4b82ed469fa75)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:44.943322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:45.071434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b521502dd2c4d01bef4b82ed469fa75', 'request_id': 'req-adc1493f-a154-4d61-8a1f-bc897cae88ef'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:45.147574 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b521502dd2c4d01bef4b82ed469fa75', 'request_id': 'req-adc1493f-a154-4d61-8a1f-bc897cae88ef'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:45.154587 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b521502dd2c4d01bef4b82ed469fa75', 'request_id': 'req-adc1493f-a154-4d61-8a1f-bc897cae88ef'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:45.182292 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] The token cache is being invalidate because project 8b521502dd2c4d01bef4b82ed469fa75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:45.182554 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:45.183433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:45.185185 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1132/2262] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:44 2022] DELETE /identity/v3/projects/8b521502dd2c4d01bef4b82ed469fa75 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:45.190122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:45.193084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:45.208305 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0442a-ffd8-466f-9417-422d0756d5f3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:45.291675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7b19a-91fb-4b27-b37d-2779cbb5de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:45.292722 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b19a-91fb-4b27-b37d-2779cbb5de17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:45.299239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b19a-91fb-4b27-b37d-2779cbb5de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:45.299239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b19a-91fb-4b27-b37d-2779cbb5de17 admin admin] PATH_INFO: `/v3/users/9aee468da63544e1bf28572fcbe06654` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:45.299239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7b19a-91fb-4b27-b37d-2779cbb5de17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aee468da63544e1bf28572fcbe06654)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:45.299239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7b19a-91fb-4b27-b37d-2779cbb5de17 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:45.573463 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ee7b19a-91fb-4b27-b37d-2779cbb5de17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aee468da63544e1bf28572fcbe06654'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:45.585505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ee7b19a-91fb-4b27-b37d-2779cbb5de17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aee468da63544e1bf28572fcbe06654'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:45.707652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ee7b19a-91fb-4b27-b37d-2779cbb5de17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aee468da63544e1bf28572fcbe06654'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:45.714784 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ee7b19a-91fb-4b27-b37d-2779cbb5de17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aee468da63544e1bf28572fcbe06654'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:45.715419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ee7b19a-91fb-4b27-b37d-2779cbb5de17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aee468da63544e1bf28572fcbe06654'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:45.721966 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1131/2263] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:45 2022] DELETE /identity/v3/users/9aee468da63544e1bf28572fcbe06654 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:46.205759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:46.207312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:46.222585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1493f-a154-4d61-8a1f-bc897cae88ef admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:46.284202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:46.285078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:46.285358 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:46.292277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] PATH_INFO: `/v3/projects/e7415510c9194db1a393315d51406d75` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:46.292277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7415510c9194db1a393315d51406d75)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:46.292277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:46.416507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7415510c9194db1a393315d51406d75', 'request_id': 'req-8cb59c26-57e4-40aa-a73b-f5034fca77ed'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:46.502361 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7415510c9194db1a393315d51406d75', 'request_id': 'req-8cb59c26-57e4-40aa-a73b-f5034fca77ed'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:46.517449 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7415510c9194db1a393315d51406d75', 'request_id': 'req-8cb59c26-57e4-40aa-a73b-f5034fca77ed'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:46.520924 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] The token cache is being invalidate because project e7415510c9194db1a393315d51406d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:46.521238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:46.521902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8cb59c26-57e4-40aa-a73b-f5034fca77ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:46.523404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1133/2264] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:46 2022] DELETE /identity/v3/projects/e7415510c9194db1a393315d51406d75 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:46.528490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdec97-94b7-4572-8588-f13d76b808ca None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:46.528940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdec97-94b7-4572-8588-f13d76b808ca None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:46.529078 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdec97-94b7-4572-8588-f13d76b808ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:46.562127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f3bdec97-94b7-4572-8588-f13d76b808ca None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:46.563344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f3bdec97-94b7-4572-8588-f13d76b808ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:46.623729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1132/2265] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:46.632442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74b7d-8eb7-4c17-865c-6dae4c020eef None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:46.639520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74b7d-8eb7-4c17-865c-6dae4c020eef None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:46.639520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74b7d-8eb7-4c17-865c-6dae4c020eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:46.651964 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3bd74b7d-8eb7-4c17-865c-6dae4c020eef None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:46.653215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3bd74b7d-8eb7-4c17-865c-6dae4c020eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:46.661510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1134/2266] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:46.668287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdec97-94b7-4572-8588-f13d76b808ca None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:46.678860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdec97-94b7-4572-8588-f13d76b808ca None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:46.685447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc022-30a0-42fd-bf32-4ff7734720ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:46.685447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc022-30a0-42fd-bf32-4ff7734720ff admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:46.685447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc022-30a0-42fd-bf32-4ff7734720ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:46.685852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc022-30a0-42fd-bf32-4ff7734720ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:46.686378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc022-30a0-42fd-bf32-4ff7734720ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:27:46.686685 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc022-30a0-42fd-bf32-4ff7734720ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:46.688270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc022-30a0-42fd-bf32-4ff7734720ff admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:46.700706 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1133/2267] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:27:46.705728 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd74b7d-8eb7-4c17-865c-6dae4c020eef None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:46.714877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd74b7d-8eb7-4c17-865c-6dae4c020eef None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:46.720337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af014e-497f-4ccf-9856-a15624e0db4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:46.721097 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af014e-497f-4ccf-9856-a15624e0db4d admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:46.721380 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af014e-497f-4ccf-9856-a15624e0db4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:46.721653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af014e-497f-4ccf-9856-a15624e0db4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:46.722350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af014e-497f-4ccf-9856-a15624e0db4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:46.724249 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af014e-497f-4ccf-9856-a15624e0db4d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:46.857895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1135/2268] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:27:46 2022] POST /identity/v3/projects => generated 397 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:46.862259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc022-30a0-42fd-bf32-4ff7734720ff admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:46.872233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc022-30a0-42fd-bf32-4ff7734720ff admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:46.929012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc7ffa-70b7-465d-9676-59d62abb0ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:46.929695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc7ffa-70b7-465d-9676-59d62abb0ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:46.929980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc7ffa-70b7-465d-9676-59d62abb0ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:46.930255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc7ffa-70b7-465d-9676-59d62abb0ebe admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:46.930970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc7ffa-70b7-465d-9676-59d62abb0ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:46.932942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc7ffa-70b7-465d-9676-59d62abb0ebe admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:47.039669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1134/2269] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:27:46 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:27:47.041465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af014e-497f-4ccf-9856-a15624e0db4d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:47.051746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af014e-497f-4ccf-9856-a15624e0db4d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:47.056394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfead1fc-c4d2-40d5-b58b-71dae28fd6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:47.057088 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfead1fc-c4d2-40d5-b58b-71dae28fd6ba admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:47.057373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfead1fc-c4d2-40d5-b58b-71dae28fd6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:47.057648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfead1fc-c4d2-40d5-b58b-71dae28fd6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:47.058374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfead1fc-c4d2-40d5-b58b-71dae28fd6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:47.059978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfead1fc-c4d2-40d5-b58b-71dae28fd6ba admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:47.071285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1136/2270] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:47.075396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc7ffa-70b7-465d-9676-59d62abb0ebe admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:47.086437 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc7ffa-70b7-465d-9676-59d62abb0ebe admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:47.091334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf6e8-30d3-4c97-9679-6a2710a4eb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:47.091993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf6e8-30d3-4c97-9679-6a2710a4eb69 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:47.092281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf6e8-30d3-4c97-9679-6a2710a4eb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:47.092554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf6e8-30d3-4c97-9679-6a2710a4eb69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:47.093391 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebf6e8-30d3-4c97-9679-6a2710a4eb69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:47.095107 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebf6e8-30d3-4c97-9679-6a2710a4eb69 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:47.105214 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1135/2271] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:27:47.109526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfead1fc-c4d2-40d5-b58b-71dae28fd6ba admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:47.119430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfead1fc-c4d2-40d5-b58b-71dae28fd6ba admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:47.124077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0235cbd-6207-4c8d-83fa-773d78ee4f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:47.124953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235cbd-6207-4c8d-83fa-773d78ee4f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:47.125258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235cbd-6207-4c8d-83fa-773d78ee4f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:47.125532 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235cbd-6207-4c8d-83fa-773d78ee4f5b admin admin] PATH_INFO: `/v3/projects/5de666fb05f245a289f50678c258bc73/users/6ee3796a231f48468f0ef9dc341ec260/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:47.140351 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0235cbd-6207-4c8d-83fa-773d78ee4f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de666fb05f245a289f50678c258bc73, user_id=6ee3796a231f48468f0ef9dc341ec260, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:47.143732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0235cbd-6207-4c8d-83fa-773d78ee4f5b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:47.256572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1137/2272] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:27:47 2022] PUT /identity/v3/projects/5de666fb05f245a289f50678c258bc73/users/6ee3796a231f48468f0ef9dc341ec260/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:27:47.268378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a60e-5d97-45ac-85b4-a36000833fbb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:47.268669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a60e-5d97-45ac-85b4-a36000833fbb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:47.268947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a60e-5d97-45ac-85b4-a36000833fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:47.294355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bbd8a60e-5d97-45ac-85b4-a36000833fbb None None] MFA Rules not processed for user `6ee3796a231f48468f0ef9dc341ec260`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:47.295548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bbd8a60e-5d97-45ac-85b4-a36000833fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:47.363726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1136/2273] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:47.375209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0235cbd-6207-4c8d-83fa-773d78ee4f5b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:47.392675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e0235cbd-6207-4c8d-83fa-773d78ee4f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:47.448768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0235cbd-6207-4c8d-83fa-773d78ee4f5b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:47.454899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fda7ea-d3f5-4def-a8ab-2857e5af2db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:47.454899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda7ea-d3f5-4def-a8ab-2857e5af2db7 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:47.454899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda7ea-d3f5-4def-a8ab-2857e5af2db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:47.454899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda7ea-d3f5-4def-a8ab-2857e5af2db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:47.465856 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fda7ea-d3f5-4def-a8ab-2857e5af2db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:47.468621 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fda7ea-d3f5-4def-a8ab-2857e5af2db7 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:47.479490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1138/2274] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:55.371847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e64f-adaf-4ea4-a90d-108e704730cd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:55.372294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e64f-adaf-4ea4-a90d-108e704730cd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:55.372406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e64f-adaf-4ea4-a90d-108e704730cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:55.405970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9602e64f-adaf-4ea4-a90d-108e704730cd None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:55.407439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9602e64f-adaf-4ea4-a90d-108e704730cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:55.474648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1137/2275] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:27:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:27:55.490443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fda7ea-d3f5-4def-a8ab-2857e5af2db7 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:55.493209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e1fda7ea-d3f5-4def-a8ab-2857e5af2db7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:55.609081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fda7ea-d3f5-4def-a8ab-2857e5af2db7 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:55.615813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4da546-b665-419b-bcf0-61b276bae0a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:55.616780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4da546-b665-419b-bcf0-61b276bae0a9 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:55.617341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4da546-b665-419b-bcf0-61b276bae0a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:55.617679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4da546-b665-419b-bcf0-61b276bae0a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:55.630893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4da546-b665-419b-bcf0-61b276bae0a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:55.632505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4da546-b665-419b-bcf0-61b276bae0a9 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:55.641146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1139/2276] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:27:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:27:57.042512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602e64f-adaf-4ea4-a90d-108e704730cd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:57.124558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602e64f-adaf-4ea4-a90d-108e704730cd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:57.130585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:57.140415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:57.140904 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:57.141362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] PATH_INFO: `/v3/users/6ee3796a231f48468f0ef9dc341ec260` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:57.146663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee3796a231f48468f0ef9dc341ec260)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:57.146663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:57.364557 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee3796a231f48468f0ef9dc341ec260'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:57.379422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee3796a231f48468f0ef9dc341ec260'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:57.460941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee3796a231f48468f0ef9dc341ec260'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:57.472372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee3796a231f48468f0ef9dc341ec260'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:57.473363 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee3796a231f48468f0ef9dc341ec260'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:57.481176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1138/2277] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:27:57 2022] DELETE /identity/v3/users/6ee3796a231f48468f0ef9dc341ec260 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:27:57.485611 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d9d11-a6c0-4df7-b9d8-3fb4ae3b72de None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:57.486101 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d9d11-a6c0-4df7-b9d8-3fb4ae3b72de None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:57.486257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d9d11-a6c0-4df7-b9d8-3fb4ae3b72de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:57.510281 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-642d9d11-a6c0-4df7-b9d8-3fb4ae3b72de None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:27:57.511736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-642d9d11-a6c0-4df7-b9d8-3fb4ae3b72de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:57.585803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1140/2278] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:27:57.596022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:57.598339 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:57.671850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5513f1-6252-4c63-874e-e499364b98b9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:57.681659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4689392-159f-43c7-8f39-0147a2137c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:57.682392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689392-159f-43c7-8f39-0147a2137c8b service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:57.682681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689392-159f-43c7-8f39-0147a2137c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:57.682963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689392-159f-43c7-8f39-0147a2137c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:57.695477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4689392-159f-43c7-8f39-0147a2137c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:57.697194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4689392-159f-43c7-8f39-0147a2137c8b service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:57.710112 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1139/2279] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:27:58.431871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d9d11-a6c0-4df7-b9d8-3fb4ae3b72de None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:27:58.433810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-642d9d11-a6c0-4df7-b9d8-3fb4ae3b72de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:27:58.453249 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d9d11-a6c0-4df7-b9d8-3fb4ae3b72de None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:27:58.463287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:27:58.464557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:27:58.465199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:27:58.465701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] PATH_INFO: `/v3/projects/5de666fb05f245a289f50678c258bc73` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:27:58.467326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de666fb05f245a289f50678c258bc73)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:27:58.469709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:27:58.610449 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de666fb05f245a289f50678c258bc73', 'request_id': 'req-6f6fc84c-885d-4247-9a56-47e3b161c699'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:58.689298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de666fb05f245a289f50678c258bc73', 'request_id': 'req-6f6fc84c-885d-4247-9a56-47e3b161c699'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:58.698072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de666fb05f245a289f50678c258bc73', 'request_id': 'req-6f6fc84c-885d-4247-9a56-47e3b161c699'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:58.715537 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] The token cache is being invalidate because project 5de666fb05f245a289f50678c258bc73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:27:58.716362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:58.717356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:27:58.720495 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1141/2280] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:27:58 2022] DELETE /identity/v3/projects/5de666fb05f245a289f50678c258bc73 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:00.277620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f21d5-325d-4cde-ae0a-9254506fc9fe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:00.278127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f21d5-325d-4cde-ae0a-9254506fc9fe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:00.278300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f21d5-325d-4cde-ae0a-9254506fc9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:00.301002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b50f21d5-325d-4cde-ae0a-9254506fc9fe None None] MFA Rules not processed for user `764047899a7f46569e12e14dda41b30d`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:00.302918 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b50f21d5-325d-4cde-ae0a-9254506fc9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:00.377047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1140/2281] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:09.369914 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:09.371903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:09.462452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc84c-885d-4247-9a56-47e3b161c699 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:09.467192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:09.468067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:09.468341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:09.468607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] PATH_INFO: `/v3/users/5599531908394fa5ba8bfe1588f294bd` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:09.469861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] RBAC: Authorizing `identity:delete_user(user_id=5599531908394fa5ba8bfe1588f294bd)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:09.472273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:09.849736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5599531908394fa5ba8bfe1588f294bd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:09.863993 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5599531908394fa5ba8bfe1588f294bd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:09.864818 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5599531908394fa5ba8bfe1588f294bd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:09.873110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5599531908394fa5ba8bfe1588f294bd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:09.873721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5599531908394fa5ba8bfe1588f294bd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:09.968828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1142/2282] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:28:09 2022] DELETE /identity/v3/users/5599531908394fa5ba8bfe1588f294bd => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:09.973503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fde1d-a8ca-41a2-a364-40ebcfb1f6fe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:09.974069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fde1d-a8ca-41a2-a364-40ebcfb1f6fe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:09.974421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fde1d-a8ca-41a2-a364-40ebcfb1f6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:09.993456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5c3fde1d-a8ca-41a2-a364-40ebcfb1f6fe None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:09.995125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5c3fde1d-a8ca-41a2-a364-40ebcfb1f6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:10.077058 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1141/2283] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:10.089222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:10.091330 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:10.163205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a114c-9e17-4bf3-9316-304632c10def admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:10.168023 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f25f1-71e0-446f-9b0f-4fc27cf5dab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:10.168386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f25f1-71e0-446f-9b0f-4fc27cf5dab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:10.168889 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f25f1-71e0-446f-9b0f-4fc27cf5dab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:10.169218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f25f1-71e0-446f-9b0f-4fc27cf5dab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:10.180656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f25f1-71e0-446f-9b0f-4fc27cf5dab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:10.182205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f25f1-71e0-446f-9b0f-4fc27cf5dab3 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:10.193679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1143/2284] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:28:10.297392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fde1d-a8ca-41a2-a364-40ebcfb1f6fe None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:10.301365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5c3fde1d-a8ca-41a2-a364-40ebcfb1f6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:10.323369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fde1d-a8ca-41a2-a364-40ebcfb1f6fe None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:10.337427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:10.338474 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:10.339278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:10.339278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] PATH_INFO: `/v3/users/a95c9e197c83492a8a841660706198cf` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:10.341872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95c9e197c83492a8a841660706198cf)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:10.343817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:10.616422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95c9e197c83492a8a841660706198cf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:10.648386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95c9e197c83492a8a841660706198cf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:10.863128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95c9e197c83492a8a841660706198cf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:10.870505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95c9e197c83492a8a841660706198cf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:10.871136 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95c9e197c83492a8a841660706198cf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:10.877083 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1142/2285] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:28:10 2022] DELETE /identity/v3/users/a95c9e197c83492a8a841660706198cf => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:10.882566 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac478a-73a5-418d-a923-0adcd817fd16 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:10.883117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac478a-73a5-418d-a923-0adcd817fd16 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:10.883117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac478a-73a5-418d-a923-0adcd817fd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:10.901672 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e6ac478a-73a5-418d-a923-0adcd817fd16 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:10.902878 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e6ac478a-73a5-418d-a923-0adcd817fd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:10.956726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:10.958672 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:10.987259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1144/2286] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:10.995385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac478a-73a5-418d-a923-0adcd817fd16 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:10.999492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e6ac478a-73a5-418d-a923-0adcd817fd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:11.055548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400433-f3ac-4842-8974-05125b619d0a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:11.063697 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:11.065441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:11.065910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:11.066285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] PATH_INFO: `/v3/projects/32b7769b89c24062a0adb9089b550775` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:11.067878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b7769b89c24062a0adb9089b550775)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:11.070751 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:11.078694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac478a-73a5-418d-a923-0adcd817fd16 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:11.084812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17635b-fd66-4ead-8f61-9322addf2596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:11.085612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17635b-fd66-4ead-8f61-9322addf2596 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:11.085912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17635b-fd66-4ead-8f61-9322addf2596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:11.086192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17635b-fd66-4ead-8f61-9322addf2596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:11.106539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17635b-fd66-4ead-8f61-9322addf2596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:11.108035 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17635b-fd66-4ead-8f61-9322addf2596 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:11.123385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1145/2287] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:28:11.232514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b7769b89c24062a0adb9089b550775', 'request_id': 'req-0e5da8b6-999b-4366-a30b-2c40bc87beb2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:11.433904 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b7769b89c24062a0adb9089b550775', 'request_id': 'req-0e5da8b6-999b-4366-a30b-2c40bc87beb2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:11.441501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b7769b89c24062a0adb9089b550775', 'request_id': 'req-0e5da8b6-999b-4366-a30b-2c40bc87beb2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:11.452789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] The token cache is being invalidate because project 32b7769b89c24062a0adb9089b550775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:28:11.453097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:11.453809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0e5da8b6-999b-4366-a30b-2c40bc87beb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:11.455503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1143/2288] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:28:10 2022] DELETE /identity/v3/projects/32b7769b89c24062a0adb9089b550775 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:11.459748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17635b-fd66-4ead-8f61-9322addf2596 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:11.470184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17635b-fd66-4ead-8f61-9322addf2596 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:11.531642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e08acd-d937-4c4a-abb8-03bb46e64e3d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:11.531930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e08acd-d937-4c4a-abb8-03bb46e64e3d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:11.532204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e08acd-d937-4c4a-abb8-03bb46e64e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:11.553572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b0e08acd-d937-4c4a-abb8-03bb46e64e3d None None] MFA Rules not processed for user `ceb69d85e1f24983aa9de1557e468494`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:11.554489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18a11-189c-4b41-a0b7-8e304678a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:11.554984 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0e08acd-d937-4c4a-abb8-03bb46e64e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:11.556142 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18a11-189c-4b41-a0b7-8e304678a9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:11.556643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18a11-189c-4b41-a0b7-8e304678a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:11.557204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18a11-189c-4b41-a0b7-8e304678a9f4 admin admin] PATH_INFO: `/v3/users/c2b8d9dbe0424c1fa783b91d372667be` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:11.559075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d18a11-189c-4b41-a0b7-8e304678a9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b8d9dbe0424c1fa783b91d372667be)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:11.562301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d18a11-189c-4b41-a0b7-8e304678a9f4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:11.654183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1144/2289] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:28:11.882408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e2d18a11-189c-4b41-a0b7-8e304678a9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b8d9dbe0424c1fa783b91d372667be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:11.897286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e2d18a11-189c-4b41-a0b7-8e304678a9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b8d9dbe0424c1fa783b91d372667be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:11.898211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e2d18a11-189c-4b41-a0b7-8e304678a9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b8d9dbe0424c1fa783b91d372667be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:11.905239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e2d18a11-189c-4b41-a0b7-8e304678a9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b8d9dbe0424c1fa783b91d372667be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:11.906005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e2d18a11-189c-4b41-a0b7-8e304678a9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b8d9dbe0424c1fa783b91d372667be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:12.434356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1146/2290] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:28:11 2022] DELETE /identity/v3/users/c2b8d9dbe0424c1fa783b91d372667be => generated 0 bytes in 975 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:12.443680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e08acd-d937-4c4a-abb8-03bb46e64e3d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:12.445306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0e08acd-d937-4c4a-abb8-03bb46e64e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:12.463447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e08acd-d937-4c4a-abb8-03bb46e64e3d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:12.544231 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:12.545154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:12.545438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:12.545737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] PATH_INFO: `/v3/projects/6311e2d40ee1421aa407b78e9941c7ac` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:12.547136 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6311e2d40ee1421aa407b78e9941c7ac)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:12.549533 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:12.701988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6311e2d40ee1421aa407b78e9941c7ac', 'request_id': 'req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:12.771701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6311e2d40ee1421aa407b78e9941c7ac', 'request_id': 'req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:12.781373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6311e2d40ee1421aa407b78e9941c7ac', 'request_id': 'req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:12.797908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] The token cache is being invalidate because project 6311e2d40ee1421aa407b78e9941c7ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:28:12.799764 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:12.799764 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fd1a7192-6235-4dd1-b7ba-f79b6e0b8411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:12.801206 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1145/2291] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:28:12 2022] DELETE /identity/v3/projects/6311e2d40ee1421aa407b78e9941c7ac => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:12.806265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6afd75-8802-4575-8478-63b2f117f304 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:12.806562 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6afd75-8802-4575-8478-63b2f117f304 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:12.806867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6afd75-8802-4575-8478-63b2f117f304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:12.829344 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7a6afd75-8802-4575-8478-63b2f117f304 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:12.831299 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7a6afd75-8802-4575-8478-63b2f117f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:12.904070 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1147/2292] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:12.914350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f061628-7cc8-4d56-ad4c-b50b6e6b44fe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:12.914350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f061628-7cc8-4d56-ad4c-b50b6e6b44fe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:12.914350 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f061628-7cc8-4d56-ad4c-b50b6e6b44fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:12.933229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4f061628-7cc8-4d56-ad4c-b50b6e6b44fe None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:12.934345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4f061628-7cc8-4d56-ad4c-b50b6e6b44fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:12.951807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1146/2293] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:12.956659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6afd75-8802-4575-8478-63b2f117f304 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:12.971090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6afd75-8802-4575-8478-63b2f117f304 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:12.980858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e10d-6859-4a9d-9c62-19dc831cb236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:12.982224 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e10d-6859-4a9d-9c62-19dc831cb236 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:12.982426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e10d-6859-4a9d-9c62-19dc831cb236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:12.982707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e10d-6859-4a9d-9c62-19dc831cb236 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:12.983538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450e10d-6859-4a9d-9c62-19dc831cb236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:28:12.983852 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450e10d-6859-4a9d-9c62-19dc831cb236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:12.985648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450e10d-6859-4a9d-9c62-19dc831cb236 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.004016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1148/2294] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:28:13.013143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f061628-7cc8-4d56-ad4c-b50b6e6b44fe None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.022872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f061628-7cc8-4d56-ad4c-b50b6e6b44fe None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.027703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff6993-0ef5-4c5c-b18b-5bb0083ad032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.028453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff6993-0ef5-4c5c-b18b-5bb0083ad032 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.028811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff6993-0ef5-4c5c-b18b-5bb0083ad032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.029148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff6993-0ef5-4c5c-b18b-5bb0083ad032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.029930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff6993-0ef5-4c5c-b18b-5bb0083ad032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.031842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff6993-0ef5-4c5c-b18b-5bb0083ad032 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.044883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e10d-6859-4a9d-9c62-19dc831cb236 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.047655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3450e10d-6859-4a9d-9c62-19dc831cb236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:13.066822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e10d-6859-4a9d-9c62-19dc831cb236 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.072393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.073659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.074333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.074801 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] PATH_INFO: `/v3/projects/1809a0b944d44d258dfd637cbe2f02ad` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.077175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1809a0b944d44d258dfd637cbe2f02ad)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.079386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.159709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1147/2295] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:28:13 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:28:13.160930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff6993-0ef5-4c5c-b18b-5bb0083ad032 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.217545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1809a0b944d44d258dfd637cbe2f02ad', 'request_id': 'req-d2cc190e-d808-475c-8e8f-05489b47a4f7'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:13.225580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff6993-0ef5-4c5c-b18b-5bb0083ad032 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.282065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69e34a-960a-42d8-a3ed-fec01b6331ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.282733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69e34a-960a-42d8-a3ed-fec01b6331ac admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.283012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69e34a-960a-42d8-a3ed-fec01b6331ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.283284 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69e34a-960a-42d8-a3ed-fec01b6331ac admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.284512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69e34a-960a-42d8-a3ed-fec01b6331ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.286431 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69e34a-960a-42d8-a3ed-fec01b6331ac admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.312064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1809a0b944d44d258dfd637cbe2f02ad', 'request_id': 'req-d2cc190e-d808-475c-8e8f-05489b47a4f7'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:13.320303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1809a0b944d44d258dfd637cbe2f02ad', 'request_id': 'req-d2cc190e-d808-475c-8e8f-05489b47a4f7'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:13.330699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] The token cache is being invalidate because project 1809a0b944d44d258dfd637cbe2f02ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:28:13.330995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:13.331664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d2cc190e-d808-475c-8e8f-05489b47a4f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:13.333241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1149/2296] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:28:13 2022] DELETE /identity/v3/projects/1809a0b944d44d258dfd637cbe2f02ad => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:13.338074 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf7d59-6a8d-450e-85ea-8fa9877504b1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.338363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf7d59-6a8d-450e-85ea-8fa9877504b1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.338645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf7d59-6a8d-450e-85ea-8fa9877504b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.357071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-adaf7d59-6a8d-450e-85ea-8fa9877504b1 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:13.358263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-adaf7d59-6a8d-450e-85ea-8fa9877504b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:13.367552 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1150/2297] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:28:13.375287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc9c52-1533-4151-9143-6b1ac288f673 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.375589 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc9c52-1533-4151-9143-6b1ac288f673 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.375890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc9c52-1533-4151-9143-6b1ac288f673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.395874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-72bc9c52-1533-4151-9143-6b1ac288f673 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:13.397246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-72bc9c52-1533-4151-9143-6b1ac288f673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:13.405948 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1151/2298] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:28:13.410382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc9c52-1533-4151-9143-6b1ac288f673 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.415255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1148/2299] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:28:13 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:28:13.416342 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69e34a-960a-42d8-a3ed-fec01b6331ac admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.418100 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fd69e34a-960a-42d8-a3ed-fec01b6331ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:13.419795 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc9c52-1533-4151-9143-6b1ac288f673 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.424921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490f893-db1d-4317-9561-f1134f8a56c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.425782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490f893-db1d-4317-9561-f1134f8a56c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.426098 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490f893-db1d-4317-9561-f1134f8a56c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.426594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490f893-db1d-4317-9561-f1134f8a56c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.427133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490f893-db1d-4317-9561-f1134f8a56c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:28:13.427561 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490f893-db1d-4317-9561-f1134f8a56c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.429186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490f893-db1d-4317-9561-f1134f8a56c0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.445376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69e34a-960a-42d8-a3ed-fec01b6331ac admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.447632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1152/2300] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:28:13.451479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490f893-db1d-4317-9561-f1134f8a56c0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.453743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e2cb1-cbae-4ac0-8daa-2e65d07d5664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.454415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2cb1-cbae-4ac0-8daa-2e65d07d5664 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.454701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2cb1-cbae-4ac0-8daa-2e65d07d5664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.455086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2cb1-cbae-4ac0-8daa-2e65d07d5664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.456303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e2cb1-cbae-4ac0-8daa-2e65d07d5664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.458049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e2cb1-cbae-4ac0-8daa-2e65d07d5664 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.467149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490f893-db1d-4317-9561-f1134f8a56c0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.469067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1149/2301] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:28:13.472200 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3ceaa-bb4c-4e23-9cb6-e83de57ade06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.473289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e2cb1-cbae-4ac0-8daa-2e65d07d5664 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.473871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3ceaa-bb4c-4e23-9cb6-e83de57ade06 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.474252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3ceaa-bb4c-4e23-9cb6-e83de57ade06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.474638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3ceaa-bb4c-4e23-9cb6-e83de57ade06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.475482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3ceaa-bb4c-4e23-9cb6-e83de57ade06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.477654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3ceaa-bb4c-4e23-9cb6-e83de57ade06 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.489807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e2cb1-cbae-4ac0-8daa-2e65d07d5664 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.496048 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caa395-5287-498d-b482-5fd6e72f0368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.500035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caa395-5287-498d-b482-5fd6e72f0368 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.500035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caa395-5287-498d-b482-5fd6e72f0368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.500035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caa395-5287-498d-b482-5fd6e72f0368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.500035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9caa395-5287-498d-b482-5fd6e72f0368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.500035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9caa395-5287-498d-b482-5fd6e72f0368 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.511138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1150/2302] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:28:13.515297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caa395-5287-498d-b482-5fd6e72f0368 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.525785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caa395-5287-498d-b482-5fd6e72f0368 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.530670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc471f7b-2069-4621-9e70-01f520c29092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.531551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471f7b-2069-4621-9e70-01f520c29092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.531830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471f7b-2069-4621-9e70-01f520c29092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.532098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471f7b-2069-4621-9e70-01f520c29092 admin admin] PATH_INFO: `/v3/projects/3af02e9bb784480aadd961a96166bc9f/users/9684f1e155a04dd999a8e906524e00df/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.546625 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471f7b-2069-4621-9e70-01f520c29092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af02e9bb784480aadd961a96166bc9f, user_id=9684f1e155a04dd999a8e906524e00df, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.553379 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471f7b-2069-4621-9e70-01f520c29092 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.613229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1153/2303] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:28:13 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:28:13.617492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3ceaa-bb4c-4e23-9cb6-e83de57ade06 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.648906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1151/2304] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:28:13 2022] PUT /identity/v3/projects/3af02e9bb784480aadd961a96166bc9f/users/9684f1e155a04dd999a8e906524e00df/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:28:13.660726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a394e0-8434-4bc7-8941-698ea88d0df9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.661275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a394e0-8434-4bc7-8941-698ea88d0df9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.661717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a394e0-8434-4bc7-8941-698ea88d0df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.710912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d9a394e0-8434-4bc7-8941-698ea88d0df9 None None] MFA Rules not processed for user `9684f1e155a04dd999a8e906524e00df`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:13.712423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d9a394e0-8434-4bc7-8941-698ea88d0df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:13.739918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3ceaa-bb4c-4e23-9cb6-e83de57ade06 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.826285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1466a0-b246-444e-99f6-0d44148152ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.827013 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1466a0-b246-444e-99f6-0d44148152ca admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.827295 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1466a0-b246-444e-99f6-0d44148152ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.827568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1466a0-b246-444e-99f6-0d44148152ca admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.828832 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1466a0-b246-444e-99f6-0d44148152ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.831781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1466a0-b246-444e-99f6-0d44148152ca admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.837208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1152/2305] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:28:13.844598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a394e0-8434-4bc7-8941-698ea88d0df9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.848316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d9a394e0-8434-4bc7-8941-698ea88d0df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:13.905955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1154/2306] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:28:13 2022] POST /identity/v3/users => generated 288 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:28:13.911349 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1466a0-b246-444e-99f6-0d44148152ca admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.921853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1466a0-b246-444e-99f6-0d44148152ca admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.927618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52764bde-53c7-41fb-bcee-b58f5e9f5f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.928284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52764bde-53c7-41fb-bcee-b58f5e9f5f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.928564 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52764bde-53c7-41fb-bcee-b58f5e9f5f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.928842 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52764bde-53c7-41fb-bcee-b58f5e9f5f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.929603 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52764bde-53c7-41fb-bcee-b58f5e9f5f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.931225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52764bde-53c7-41fb-bcee-b58f5e9f5f7a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.942222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1155/2307] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:28:13.949723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52764bde-53c7-41fb-bcee-b58f5e9f5f7a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:13.951053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a394e0-8434-4bc7-8941-698ea88d0df9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.954883 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e4fea-540d-456b-a2ae-670715792698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.956414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e4fea-540d-456b-a2ae-670715792698 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.956726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e4fea-540d-456b-a2ae-670715792698 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.957045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e4fea-540d-456b-a2ae-670715792698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.960646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52764bde-53c7-41fb-bcee-b58f5e9f5f7a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:13.965406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177c9f2-1ebc-421d-a7e1-e9991d073f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:13.965914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e4fea-540d-456b-a2ae-670715792698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.966170 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177c9f2-1ebc-421d-a7e1-e9991d073f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:13.967051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177c9f2-1ebc-421d-a7e1-e9991d073f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:13.967336 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177c9f2-1ebc-421d-a7e1-e9991d073f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:13.967651 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e4fea-540d-456b-a2ae-670715792698 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.968058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177c9f2-1ebc-421d-a7e1-e9991d073f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:13.969690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177c9f2-1ebc-421d-a7e1-e9991d073f2f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:13.979536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1153/2308] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:28:13.994762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1156/2309] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:28:13.998719 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e4fea-540d-456b-a2ae-670715792698 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:14.013951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177c9f2-1ebc-421d-a7e1-e9991d073f2f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:14.016378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e4fea-540d-456b-a2ae-670715792698 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:14.022676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e3358-5b11-4d22-b25e-1f608f6d00d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:14.024199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e3358-5b11-4d22-b25e-1f608f6d00d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:14.024485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e3358-5b11-4d22-b25e-1f608f6d00d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:14.024763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e3358-5b11-4d22-b25e-1f608f6d00d5 admin admin] PATH_INFO: `/v3/projects/06b6ed7772a34569aaba5326c0629fd6/users/ac834e4d8ba84dccbbd61efc734f2692/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:14.025760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177c9f2-1ebc-421d-a7e1-e9991d073f2f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:14.031960 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122265b-b8c8-4508-81ea-6e5384b7b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:14.032838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122265b-b8c8-4508-81ea-6e5384b7b21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:14.033974 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122265b-b8c8-4508-81ea-6e5384b7b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:14.033974 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122265b-b8c8-4508-81ea-6e5384b7b21a admin admin] PATH_INFO: `/v3/users/9684f1e155a04dd999a8e906524e00df` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:14.035436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122265b-b8c8-4508-81ea-6e5384b7b21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9684f1e155a04dd999a8e906524e00df)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:14.037800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122265b-b8c8-4508-81ea-6e5384b7b21a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:14.053167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e3358-5b11-4d22-b25e-1f608f6d00d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b6ed7772a34569aaba5326c0629fd6, user_id=ac834e4d8ba84dccbbd61efc734f2692, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:14.057042 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e3358-5b11-4d22-b25e-1f608f6d00d5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:14.186616 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1154/2310] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:28:13 2022] PUT /identity/v3/projects/06b6ed7772a34569aaba5326c0629fd6/users/ac834e4d8ba84dccbbd61efc734f2692/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:14.204132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac948de-1747-4b89-8871-81dff78ab78e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:14.204487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac948de-1747-4b89-8871-81dff78ab78e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:14.204855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac948de-1747-4b89-8871-81dff78ab78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:14.240451 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-aac948de-1747-4b89-8871-81dff78ab78e None None] MFA Rules not processed for user `ac834e4d8ba84dccbbd61efc734f2692`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:14.241848 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aac948de-1747-4b89-8871-81dff78ab78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:14.272057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8122265b-b8c8-4508-81ea-6e5384b7b21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9684f1e155a04dd999a8e906524e00df'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:14.305404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8122265b-b8c8-4508-81ea-6e5384b7b21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9684f1e155a04dd999a8e906524e00df'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:14.307644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8122265b-b8c8-4508-81ea-6e5384b7b21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9684f1e155a04dd999a8e906524e00df'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:14.316913 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8122265b-b8c8-4508-81ea-6e5384b7b21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9684f1e155a04dd999a8e906524e00df'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:14.317979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8122265b-b8c8-4508-81ea-6e5384b7b21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9684f1e155a04dd999a8e906524e00df'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:14.326991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1155/2311] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:28:14.332855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac948de-1747-4b89-8871-81dff78ab78e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:14.407975 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac948de-1747-4b89-8871-81dff78ab78e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:14.414777 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13ad86-6edd-4829-8aad-24b9bb215d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:14.415729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13ad86-6edd-4829-8aad-24b9bb215d69 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:14.415908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13ad86-6edd-4829-8aad-24b9bb215d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:14.416231 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13ad86-6edd-4829-8aad-24b9bb215d69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:14.417032 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13ad86-6edd-4829-8aad-24b9bb215d69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:14.419866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13ad86-6edd-4829-8aad-24b9bb215d69 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:14.442499 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1157/2312] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:28:14 2022] DELETE /identity/v3/users/9684f1e155a04dd999a8e906524e00df => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:28:14.451063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96037-b629-4199-a997-0dd0ddc85d20 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:14.451351 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96037-b629-4199-a997-0dd0ddc85d20 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:14.452061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96037-b629-4199-a997-0dd0ddc85d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:14.475604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e7f96037-b629-4199-a997-0dd0ddc85d20 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:14.478606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e7f96037-b629-4199-a997-0dd0ddc85d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:14.573980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1158/2313] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:14.586172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f96037-b629-4199-a997-0dd0ddc85d20 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:14.587880 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e7f96037-b629-4199-a997-0dd0ddc85d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:14.598699 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1156/2314] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:28:14 2022] POST /identity/v3/projects => generated 377 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:28:14.603110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13ad86-6edd-4829-8aad-24b9bb215d69 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:14.611951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ef13ad86-6edd-4829-8aad-24b9bb215d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:14.682783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f96037-b629-4199-a997-0dd0ddc85d20 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:14.733191 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13ad86-6edd-4829-8aad-24b9bb215d69 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:14.740257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3d78-2590-46b0-af64-eef258cb868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:14.740953 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3d78-2590-46b0-af64-eef258cb868a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:14.741283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3d78-2590-46b0-af64-eef258cb868a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:14.741559 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3d78-2590-46b0-af64-eef258cb868a admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:14.742257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d3d78-2590-46b0-af64-eef258cb868a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:14.744180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d3d78-2590-46b0-af64-eef258cb868a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:14.754808 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87153f55-52a1-491f-9f66-4f5766602db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:14.755478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87153f55-52a1-491f-9f66-4f5766602db8 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:14.755759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87153f55-52a1-491f-9f66-4f5766602db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:14.756033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87153f55-52a1-491f-9f66-4f5766602db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:14.766444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87153f55-52a1-491f-9f66-4f5766602db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:14.768071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87153f55-52a1-491f-9f66-4f5766602db8 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:14.778574 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1159/2315] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:28:14.900041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1157/2316] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:28:14 2022] POST /identity/v3/users => generated 295 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:28:14.906541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87153f55-52a1-491f-9f66-4f5766602db8 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:14.924756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87153f55-52a1-491f-9f66-4f5766602db8 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:14.929992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac9a60-4a1f-4de4-9a90-e878df5c2c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:14.931663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9a60-4a1f-4de4-9a90-e878df5c2c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:14.931663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9a60-4a1f-4de4-9a90-e878df5c2c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:14.931663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9a60-4a1f-4de4-9a90-e878df5c2c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:14.932251 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac9a60-4a1f-4de4-9a90-e878df5c2c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:14.934000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac9a60-4a1f-4de4-9a90-e878df5c2c63 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:14.951177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1160/2317] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:28:14.956938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3d78-2590-46b0-af64-eef258cb868a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:14.971952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3d78-2590-46b0-af64-eef258cb868a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:14.976886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4eaf7-77d6-4c3c-a412-deb798a2db3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:14.977863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4eaf7-77d6-4c3c-a412-deb798a2db3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:14.980598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4eaf7-77d6-4c3c-a412-deb798a2db3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:14.980598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4eaf7-77d6-4c3c-a412-deb798a2db3b admin admin] PATH_INFO: `/v3/projects/7a32194de8164695bf1e72b20844ad5c/users/09c1ea49de7c496cbee6f15c628721ba/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:14.994365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4eaf7-77d6-4c3c-a412-deb798a2db3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a32194de8164695bf1e72b20844ad5c, user_id=09c1ea49de7c496cbee6f15c628721ba, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:14.998023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4eaf7-77d6-4c3c-a412-deb798a2db3b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:15.076177 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1158/2318] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:28:14 2022] PUT /identity/v3/projects/7a32194de8164695bf1e72b20844ad5c/users/09c1ea49de7c496cbee6f15c628721ba/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:15.081253 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac9a60-4a1f-4de4-9a90-e878df5c2c63 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:15.099682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac9a60-4a1f-4de4-9a90-e878df5c2c63 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:15.197305 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e006a9c-79cd-4874-a80c-7c6704957c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:15.198078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e006a9c-79cd-4874-a80c-7c6704957c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:15.205712 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e006a9c-79cd-4874-a80c-7c6704957c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:15.205893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e006a9c-79cd-4874-a80c-7c6704957c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:15.207333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e006a9c-79cd-4874-a80c-7c6704957c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:15.209284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e006a9c-79cd-4874-a80c-7c6704957c8e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:15.231866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1161/2319] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:28:15.235946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4eaf7-77d6-4c3c-a412-deb798a2db3b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:15.257013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4eaf7-77d6-4c3c-a412-deb798a2db3b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:15.262069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74044c65-0d1d-4d91-9f4a-ea2eee26019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:15.262970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74044c65-0d1d-4d91-9f4a-ea2eee26019b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:15.263249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74044c65-0d1d-4d91-9f4a-ea2eee26019b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:15.263516 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74044c65-0d1d-4d91-9f4a-ea2eee26019b admin admin] PATH_INFO: `/v3/projects/7a32194de8164695bf1e72b20844ad5c/users/09c1ea49de7c496cbee6f15c628721ba/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:15.265651 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74044c65-0d1d-4d91-9f4a-ea2eee26019b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a32194de8164695bf1e72b20844ad5c, user_id=09c1ea49de7c496cbee6f15c628721ba, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:15.268534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74044c65-0d1d-4d91-9f4a-ea2eee26019b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:15.280819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1159/2320] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:28:15 2022] PUT /identity/v3/projects/7a32194de8164695bf1e72b20844ad5c/users/09c1ea49de7c496cbee6f15c628721ba/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:15.296604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd113f4-e7ed-4c12-8474-c7c8b995164b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:15.296604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd113f4-e7ed-4c12-8474-c7c8b995164b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:15.296604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd113f4-e7ed-4c12-8474-c7c8b995164b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:15.334740 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0cd113f4-e7ed-4c12-8474-c7c8b995164b None None] MFA Rules not processed for user `09c1ea49de7c496cbee6f15c628721ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:15.336155 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0cd113f4-e7ed-4c12-8474-c7c8b995164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:15.367046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74044c65-0d1d-4d91-9f4a-ea2eee26019b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:15.372748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-74044c65-0d1d-4d91-9f4a-ea2eee26019b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:15.459636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1162/2321] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:15.468139 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd113f4-e7ed-4c12-8474-c7c8b995164b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:15.469697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0cd113f4-e7ed-4c12-8474-c7c8b995164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:15.496072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74044c65-0d1d-4d91-9f4a-ea2eee26019b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:15.501479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:15.503114 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:15.503522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:15.503813 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] PATH_INFO: `/v3/projects/3af02e9bb784480aadd961a96166bc9f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:15.505174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af02e9bb784480aadd961a96166bc9f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:15.508809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:15.542094 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd113f4-e7ed-4c12-8474-c7c8b995164b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:15.545987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ff4c7-02ab-4945-936f-f4b7c1b30f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:15.546691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ff4c7-02ab-4945-936f-f4b7c1b30f03 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:15.546925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ff4c7-02ab-4945-936f-f4b7c1b30f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:15.547208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ff4c7-02ab-4945-936f-f4b7c1b30f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:15.549712 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9a7ff4c7-02ab-4945-936f-f4b7c1b30f03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:15.633732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ff4c7-02ab-4945-936f-f4b7c1b30f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:15.635223 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ff4c7-02ab-4945-936f-f4b7c1b30f03 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:15.664938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1163/2322] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:28:15.683580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af02e9bb784480aadd961a96166bc9f', 'request_id': 'req-8501504a-8fbc-4457-8c6b-a39eb26fcf71'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:15.763919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af02e9bb784480aadd961a96166bc9f', 'request_id': 'req-8501504a-8fbc-4457-8c6b-a39eb26fcf71'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:15.775230 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af02e9bb784480aadd961a96166bc9f', 'request_id': 'req-8501504a-8fbc-4457-8c6b-a39eb26fcf71'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:15.807509 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] The token cache is being invalidate because project 3af02e9bb784480aadd961a96166bc9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:28:15.807828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:15.808632 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8501504a-8fbc-4457-8c6b-a39eb26fcf71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:15.810774 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1160/2323] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:28:15 2022] DELETE /identity/v3/projects/3af02e9bb784480aadd961a96166bc9f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:16.607051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f4941-4bf6-4bc0-afed-9581825c7b5a None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:16.607903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f4941-4bf6-4bc0-afed-9581825c7b5a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:16.608339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f4941-4bf6-4bc0-afed-9581825c7b5a None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:16.610250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1164/2324] 10.222.0.61 () {54 vars in 921 bytes} [Tue Apr 12 14:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:28:16.629312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061500c1-79cd-4e62-b51a-dcc56d801200 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:16.629976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061500c1-79cd-4e62-b51a-dcc56d801200 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:16.630387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061500c1-79cd-4e62-b51a-dcc56d801200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:16.728540 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-061500c1-79cd-4e62-b51a-dcc56d801200 None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:16.730645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-061500c1-79cd-4e62-b51a-dcc56d801200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:16.841057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1161/2325] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Apr 12 14:28:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:16.844143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f4941-4bf6-4bc0-afed-9581825c7b5a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:16.845978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3b3f4941-4bf6-4bc0-afed-9581825c7b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:16.940415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f4941-4bf6-4bc0-afed-9581825c7b5a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:16.944648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deddcfe-3579-487b-b78a-1765d975442b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef8bbd229c488d97f167c810bc7cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:16.945357 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deddcfe-3579-487b-b78a-1765d975442b service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:16.945641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deddcfe-3579-487b-b78a-1765d975442b service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:16.945915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deddcfe-3579-487b-b78a-1765d975442b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:16.959652 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deddcfe-3579-487b-b78a-1765d975442b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:16.961334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deddcfe-3579-487b-b78a-1765d975442b service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:16.973172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1165/2326] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:28:17.184742 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c282-4c5f-4cf4-981d-79628a667a6b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:17.186017 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c282-4c5f-4cf4-981d-79628a667a6b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:17.186982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c282-4c5f-4cf4-981d-79628a667a6b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:17.193029 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1162/2327] 10.222.0.61 () {54 vars in 921 bytes} [Tue Apr 12 14:28:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:28:17.200534 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676ddf-f79b-4dc1-9e1f-241fef8fed29 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:17.201003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676ddf-f79b-4dc1-9e1f-241fef8fed29 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:17.201437 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676ddf-f79b-4dc1-9e1f-241fef8fed29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:17.246113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6b676ddf-f79b-4dc1-9e1f-241fef8fed29 None None] MFA Rules not processed for user `fa7ee0856f4644c994c3ccbd400b6fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:17.247894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6b676ddf-f79b-4dc1-9e1f-241fef8fed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:17.348156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1166/2328] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Apr 12 14:28:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:17.363109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480c282-4c5f-4cf4-981d-79628a667a6b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:17.365739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8480c282-4c5f-4cf4-981d-79628a667a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:17.387229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480c282-4c5f-4cf4-981d-79628a667a6b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:17.391963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0ede5-0bc4-4d8f-a149-89a88d8fe330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:17.393086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0ede5-0bc4-4d8f-a149-89a88d8fe330 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:17.393687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0ede5-0bc4-4d8f-a149-89a88d8fe330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:17.394162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0ede5-0bc4-4d8f-a149-89a88d8fe330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:17.402914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0ede5-0bc4-4d8f-a149-89a88d8fe330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:17.405696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0ede5-0bc4-4d8f-a149-89a88d8fe330 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:17.415053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1163/2329] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:28:17.509519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43d575-d18c-4f8d-8381-5fee71acac36 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:17.509839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43d575-d18c-4f8d-8381-5fee71acac36 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:17.510207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43d575-d18c-4f8d-8381-5fee71acac36 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:17.521397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1167/2330] 10.222.0.61 () {54 vars in 921 bytes} [Tue Apr 12 14:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:28:17.521527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be399e83-af79-457e-987d-122f26384a75 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:17.521527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be399e83-af79-457e-987d-122f26384a75 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:17.521527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be399e83-af79-457e-987d-122f26384a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:17.539481 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-be399e83-af79-457e-987d-122f26384a75 None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:17.540683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-be399e83-af79-457e-987d-122f26384a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:17.552300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1164/2331] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Apr 12 14:28:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:17.566299 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43d575-d18c-4f8d-8381-5fee71acac36 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:17.582518 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43d575-d18c-4f8d-8381-5fee71acac36 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:17.585910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f6aa2-897b-4a3d-92aa-d0b6801fcfb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:17.586657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6aa2-897b-4a3d-92aa-d0b6801fcfb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:17.587005 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6aa2-897b-4a3d-92aa-d0b6801fcfb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:17.587337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6aa2-897b-4a3d-92aa-d0b6801fcfb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:17.601461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f6aa2-897b-4a3d-92aa-d0b6801fcfb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:17.603119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f6aa2-897b-4a3d-92aa-d0b6801fcfb2 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:17.621242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1168/2332] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:28:22.403047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be399e83-af79-457e-987d-122f26384a75 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:22.403047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-be399e83-af79-457e-987d-122f26384a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:22.463724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be399e83-af79-457e-987d-122f26384a75 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:22.467332 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d67e5-5a14-4ac9-ae5f-32f93fefda9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:22.468029 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d67e5-5a14-4ac9-ae5f-32f93fefda9e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:22.468312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d67e5-5a14-4ac9-ae5f-32f93fefda9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:22.468586 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d67e5-5a14-4ac9-ae5f-32f93fefda9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:22.470460 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6a6d67e5-5a14-4ac9-ae5f-32f93fefda9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:22.544743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d67e5-5a14-4ac9-ae5f-32f93fefda9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:22.546765 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d67e5-5a14-4ac9-ae5f-32f93fefda9e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:22.558389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1165/2333] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:28:28.557342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a470-9bca-4491-ae3c-02d91daed6b2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:28.557881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a470-9bca-4491-ae3c-02d91daed6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:28.558023 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a470-9bca-4491-ae3c-02d91daed6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:28.607536 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8a22a470-9bca-4491-ae3c-02d91daed6b2 None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:28.608757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8a22a470-9bca-4491-ae3c-02d91daed6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:28.675560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1169/2334] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:28:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:28.697403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d67e5-5a14-4ac9-ae5f-32f93fefda9e service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:28.698807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6a6d67e5-5a14-4ac9-ae5f-32f93fefda9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:28.793410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d67e5-5a14-4ac9-ae5f-32f93fefda9e service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:28.798732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f27ca7-0b04-4982-8a5b-fffb211e590f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:28.802051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27ca7-0b04-4982-8a5b-fffb211e590f service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:28.802051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27ca7-0b04-4982-8a5b-fffb211e590f service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:28.802051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27ca7-0b04-4982-8a5b-fffb211e590f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:28.809441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f27ca7-0b04-4982-8a5b-fffb211e590f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:28.811300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f27ca7-0b04-4982-8a5b-fffb211e590f service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:28.821241 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1166/2335] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:28:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:28:41.666269 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22a470-9bca-4491-ae3c-02d91daed6b2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:41.668929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8a22a470-9bca-4491-ae3c-02d91daed6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:41.774084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22a470-9bca-4491-ae3c-02d91daed6b2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:41.779239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a065d1-be2c-4b1a-a026-a82e3b5eba45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7095f3ab8545c589d4d28a846ba1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:41.779951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a065d1-be2c-4b1a-a026-a82e3b5eba45 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:41.780233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a065d1-be2c-4b1a-a026-a82e3b5eba45 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:41.780536 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a065d1-be2c-4b1a-a026-a82e3b5eba45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:41.782392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-19a065d1-be2c-4b1a-a026-a82e3b5eba45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:41.795052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a065d1-be2c-4b1a-a026-a82e3b5eba45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:41.796656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a065d1-be2c-4b1a-a026-a82e3b5eba45 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:41.808291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1170/2336] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:28:50.142762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f27ca7-0b04-4982-8a5b-fffb211e590f service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:50.144205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-75f27ca7-0b04-4982-8a5b-fffb211e590f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:50.212064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f27ca7-0b04-4982-8a5b-fffb211e590f service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:50.216580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:50.217478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:50.217763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:50.218040 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] PATH_INFO: `/v3/users/ac834e4d8ba84dccbbd61efc734f2692` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:50.219228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac834e4d8ba84dccbbd61efc734f2692)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:50.221182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:50.441275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac834e4d8ba84dccbbd61efc734f2692'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:50.455724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac834e4d8ba84dccbbd61efc734f2692'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:50.564276 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac834e4d8ba84dccbbd61efc734f2692'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:50.574053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac834e4d8ba84dccbbd61efc734f2692'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:50.574714 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac834e4d8ba84dccbbd61efc734f2692'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:50.583432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1167/2337] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:28:50 2022] DELETE /identity/v3/users/ac834e4d8ba84dccbbd61efc734f2692 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:50.588164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca986dd-d97d-4f1f-bf0a-d8481fa6c692 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:50.588590 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca986dd-d97d-4f1f-bf0a-d8481fa6c692 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:50.588590 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca986dd-d97d-4f1f-bf0a-d8481fa6c692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:50.606121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8ca986dd-d97d-4f1f-bf0a-d8481fa6c692 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:50.607318 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8ca986dd-d97d-4f1f-bf0a-d8481fa6c692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:50.670725 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1171/2338] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:28:50.680807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:50.682259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:50.739813 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297307d5-160d-49cf-9497-ebc460722338 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:50.744269 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31a8c8-c1f3-4438-96a9-b14c5902d040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:50.744922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31a8c8-c1f3-4438-96a9-b14c5902d040 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:50.745238 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31a8c8-c1f3-4438-96a9-b14c5902d040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:50.745515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31a8c8-c1f3-4438-96a9-b14c5902d040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:50.755632 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31a8c8-c1f3-4438-96a9-b14c5902d040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:50.757099 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31a8c8-c1f3-4438-96a9-b14c5902d040 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:50.767219 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1168/2339] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:28:51.184784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca986dd-d97d-4f1f-bf0a-d8481fa6c692 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:51.186250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8ca986dd-d97d-4f1f-bf0a-d8481fa6c692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:51.198685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca986dd-d97d-4f1f-bf0a-d8481fa6c692 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:51.203389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:51.204246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:51.204528 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:51.204854 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] PATH_INFO: `/v3/projects/06b6ed7772a34569aaba5326c0629fd6` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:51.206096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b6ed7772a34569aaba5326c0629fd6)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:51.208485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:51.331085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b6ed7772a34569aaba5326c0629fd6', 'request_id': 'req-8664d3db-74af-44fb-bd2d-0d07c856cf7f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:51.400014 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b6ed7772a34569aaba5326c0629fd6', 'request_id': 'req-8664d3db-74af-44fb-bd2d-0d07c856cf7f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:51.406816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b6ed7772a34569aaba5326c0629fd6', 'request_id': 'req-8664d3db-74af-44fb-bd2d-0d07c856cf7f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:51.418214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] The token cache is being invalidate because project 06b6ed7772a34569aaba5326c0629fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:28:51.418507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:51.419300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:51.420743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1172/2340] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:28:51 2022] DELETE /identity/v3/projects/06b6ed7772a34569aaba5326c0629fd6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:51.424691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31a8c8-c1f3-4438-96a9-b14c5902d040 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:51.434773 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31a8c8-c1f3-4438-96a9-b14c5902d040 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:51.493512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bdf24-dda8-4d2d-baa0-f739ec5d81c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:51.494545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bdf24-dda8-4d2d-baa0-f739ec5d81c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:51.494931 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bdf24-dda8-4d2d-baa0-f739ec5d81c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:51.495330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bdf24-dda8-4d2d-baa0-f739ec5d81c7 admin admin] PATH_INFO: `/v3/users/09c1ea49de7c496cbee6f15c628721ba` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:51.496697 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bdf24-dda8-4d2d-baa0-f739ec5d81c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c1ea49de7c496cbee6f15c628721ba)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:51.498745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bdf24-dda8-4d2d-baa0-f739ec5d81c7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:51.715732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-963bdf24-dda8-4d2d-baa0-f739ec5d81c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c1ea49de7c496cbee6f15c628721ba'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:51.727989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-963bdf24-dda8-4d2d-baa0-f739ec5d81c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c1ea49de7c496cbee6f15c628721ba'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:51.809923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-963bdf24-dda8-4d2d-baa0-f739ec5d81c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c1ea49de7c496cbee6f15c628721ba'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:51.817701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-963bdf24-dda8-4d2d-baa0-f739ec5d81c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c1ea49de7c496cbee6f15c628721ba'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:51.818497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-963bdf24-dda8-4d2d-baa0-f739ec5d81c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c1ea49de7c496cbee6f15c628721ba'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:51.825162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1169/2341] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:28:51 2022] DELETE /identity/v3/users/09c1ea49de7c496cbee6f15c628721ba => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:52.274283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:52.275924 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:52.291469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664d3db-74af-44fb-bd2d-0d07c856cf7f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:52.354077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:52.355080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:52.355499 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:52.355701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] PATH_INFO: `/v3/projects/7a32194de8164695bf1e72b20844ad5c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:52.356910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a32194de8164695bf1e72b20844ad5c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:52.359333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:52.462633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a32194de8164695bf1e72b20844ad5c', 'request_id': 'req-41a6c924-2fad-4f91-8fc8-a249e083572d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:52.530114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a32194de8164695bf1e72b20844ad5c', 'request_id': 'req-41a6c924-2fad-4f91-8fc8-a249e083572d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:52.539519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a32194de8164695bf1e72b20844ad5c', 'request_id': 'req-41a6c924-2fad-4f91-8fc8-a249e083572d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:52.551907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] The token cache is being invalidate because project 7a32194de8164695bf1e72b20844ad5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:28:52.552817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:52.553513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-41a6c924-2fad-4f91-8fc8-a249e083572d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:52.555111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1173/2342] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:28:52 2022] DELETE /identity/v3/projects/7a32194de8164695bf1e72b20844ad5c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:52.561225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1c0de-464a-4adf-b988-66038fb093b1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:52.565358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1c0de-464a-4adf-b988-66038fb093b1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:52.565358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1c0de-464a-4adf-b988-66038fb093b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:52.579879 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-27c1c0de-464a-4adf-b988-66038fb093b1 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:52.581141 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-27c1c0de-464a-4adf-b988-66038fb093b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:52.643336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1170/2343] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:52.652515 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b46a2b-4e71-460b-a4b4-605a9d0aaa00 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:52.652804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b46a2b-4e71-460b-a4b4-605a9d0aaa00 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:52.653280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b46a2b-4e71-460b-a4b4-605a9d0aaa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:52.673461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-27b46a2b-4e71-460b-a4b4-605a9d0aaa00 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:52.674700 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-27b46a2b-4e71-460b-a4b4-605a9d0aaa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:52.683744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1174/2344] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:52.687665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1c0de-464a-4adf-b988-66038fb093b1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:52.698439 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1c0de-464a-4adf-b988-66038fb093b1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:52.703165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817bc53-7197-4514-92a5-6bce018a9376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:52.703835 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817bc53-7197-4514-92a5-6bce018a9376 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:52.704149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817bc53-7197-4514-92a5-6bce018a9376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:52.704421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817bc53-7197-4514-92a5-6bce018a9376 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:52.705182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817bc53-7197-4514-92a5-6bce018a9376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:28:52.705491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817bc53-7197-4514-92a5-6bce018a9376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:52.707108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817bc53-7197-4514-92a5-6bce018a9376 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:52.722737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1171/2345] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:28:52.724398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b46a2b-4e71-460b-a4b4-605a9d0aaa00 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:52.733488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b46a2b-4e71-460b-a4b4-605a9d0aaa00 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:52.738313 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced27811-c3fc-4723-8d2a-e53b82099da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:52.739596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced27811-c3fc-4723-8d2a-e53b82099da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:52.739954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced27811-c3fc-4723-8d2a-e53b82099da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:52.740294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced27811-c3fc-4723-8d2a-e53b82099da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:52.741078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced27811-c3fc-4723-8d2a-e53b82099da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:52.743064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced27811-c3fc-4723-8d2a-e53b82099da4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:52.843412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1175/2346] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:28:52 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:28:52.847797 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817bc53-7197-4514-92a5-6bce018a9376 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:52.859578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817bc53-7197-4514-92a5-6bce018a9376 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:52.918783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28698357-02b8-4089-b248-c5265e993d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:52.919453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28698357-02b8-4089-b248-c5265e993d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:52.919740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28698357-02b8-4089-b248-c5265e993d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:52.920015 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28698357-02b8-4089-b248-c5265e993d77 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:52.920704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28698357-02b8-4089-b248-c5265e993d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:52.922656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28698357-02b8-4089-b248-c5265e993d77 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:53.028173 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1172/2347] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:28:52 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:28:53.032257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced27811-c3fc-4723-8d2a-e53b82099da4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:53.042984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced27811-c3fc-4723-8d2a-e53b82099da4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:53.047708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e784d73-dbe1-47ec-9373-ccdd51b23017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:53.048373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784d73-dbe1-47ec-9373-ccdd51b23017 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:53.048657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784d73-dbe1-47ec-9373-ccdd51b23017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:53.048933 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784d73-dbe1-47ec-9373-ccdd51b23017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:53.049694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e784d73-dbe1-47ec-9373-ccdd51b23017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:53.051332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e784d73-dbe1-47ec-9373-ccdd51b23017 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:53.062730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1176/2348] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:28:53.066748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28698357-02b8-4089-b248-c5265e993d77 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:53.077138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28698357-02b8-4089-b248-c5265e993d77 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:53.081786 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497c756-24bb-4bba-9919-4c9178120ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:53.082967 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497c756-24bb-4bba-9919-4c9178120ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:53.083335 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497c756-24bb-4bba-9919-4c9178120ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:53.083650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497c756-24bb-4bba-9919-4c9178120ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:53.084428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497c756-24bb-4bba-9919-4c9178120ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:53.086060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497c756-24bb-4bba-9919-4c9178120ac0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:53.096002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1173/2349] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:28:53.101214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e784d73-dbe1-47ec-9373-ccdd51b23017 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:53.111152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e784d73-dbe1-47ec-9373-ccdd51b23017 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:53.116096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a755f32-dc62-466e-95fc-f7539871b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:53.116998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a755f32-dc62-466e-95fc-f7539871b586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:53.117287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a755f32-dc62-466e-95fc-f7539871b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:53.117563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a755f32-dc62-466e-95fc-f7539871b586 admin admin] PATH_INFO: `/v3/projects/50cf55f1268f41a1a114e2e3602b92af/users/3eefe51480704369a0e85959a4196183/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:53.263992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a755f32-dc62-466e-95fc-f7539871b586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cf55f1268f41a1a114e2e3602b92af, user_id=3eefe51480704369a0e85959a4196183, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:53.266681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a755f32-dc62-466e-95fc-f7539871b586 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:53.384134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1177/2350] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:28:53 2022] PUT /identity/v3/projects/50cf55f1268f41a1a114e2e3602b92af/users/3eefe51480704369a0e85959a4196183/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:53.394594 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e910a-fc69-4d85-9855-22dd149d101c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:53.395006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e910a-fc69-4d85-9855-22dd149d101c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:53.395824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e910a-fc69-4d85-9855-22dd149d101c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:53.423629 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-479e910a-fc69-4d85-9855-22dd149d101c None None] MFA Rules not processed for user `3eefe51480704369a0e85959a4196183`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:53.424905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-479e910a-fc69-4d85-9855-22dd149d101c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:53.497051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1174/2351] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:28:53.509509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a755f32-dc62-466e-95fc-f7539871b586 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:53.511919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8a755f32-dc62-466e-95fc-f7539871b586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:53.570559 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a755f32-dc62-466e-95fc-f7539871b586 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:53.574161 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763ffdc-d73e-4fdf-8bde-f09dce35ab15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:53.574802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763ffdc-d73e-4fdf-8bde-f09dce35ab15 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:53.575085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763ffdc-d73e-4fdf-8bde-f09dce35ab15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:53.575376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763ffdc-d73e-4fdf-8bde-f09dce35ab15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:53.584576 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763ffdc-d73e-4fdf-8bde-f09dce35ab15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:53.586062 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763ffdc-d73e-4fdf-8bde-f09dce35ab15 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:53.594869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1178/2352] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:28:57.889920 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa93267-ce6d-4b5e-8fce-efe03c474bb8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:57.890366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa93267-ce6d-4b5e-8fce-efe03c474bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:57.890456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa93267-ce6d-4b5e-8fce-efe03c474bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:57.910480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9aa93267-ce6d-4b5e-8fce-efe03c474bb8 None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:57.911655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9aa93267-ce6d-4b5e-8fce-efe03c474bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:57.965224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1175/2353] 10.222.0.61 () {58 vars in 967 bytes} [Tue Apr 12 14:28:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:57.978300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763ffdc-d73e-4fdf-8bde-f09dce35ab15 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:57.979715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c763ffdc-d73e-4fdf-8bde-f09dce35ab15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:58.044784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763ffdc-d73e-4fdf-8bde-f09dce35ab15 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:58.049754 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75457933-f4b3-49ee-8264-4d74a0847097 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:58.050414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457933-f4b3-49ee-8264-4d74a0847097 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:58.050690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457933-f4b3-49ee-8264-4d74a0847097 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:58.050979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457933-f4b3-49ee-8264-4d74a0847097 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:58.059735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75457933-f4b3-49ee-8264-4d74a0847097 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:58.061397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75457933-f4b3-49ee-8264-4d74a0847097 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:58.070386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1179/2354] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:28:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:28:58.823779 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa93267-ce6d-4b5e-8fce-efe03c474bb8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:58.889205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa93267-ce6d-4b5e-8fce-efe03c474bb8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:58.893975 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:58.895062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:58.895568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:58.895970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] PATH_INFO: `/v3/users/3eefe51480704369a0e85959a4196183` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:58.897344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eefe51480704369a0e85959a4196183)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:58.899403 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:59.093707 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eefe51480704369a0e85959a4196183'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:59.105218 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eefe51480704369a0e85959a4196183'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:59.183093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eefe51480704369a0e85959a4196183'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:59.190190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eefe51480704369a0e85959a4196183'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:59.190807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eefe51480704369a0e85959a4196183'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:28:59.197637 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1176/2355] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:28:58 2022] DELETE /identity/v3/users/3eefe51480704369a0e85959a4196183 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:28:59.202180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c129fb-9be9-4e55-8325-c0bd325e316c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:59.202654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c129fb-9be9-4e55-8325-c0bd325e316c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:59.202773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c129fb-9be9-4e55-8325-c0bd325e316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:59.220435 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-60c129fb-9be9-4e55-8325-c0bd325e316c None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:28:59.221677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-60c129fb-9be9-4e55-8325-c0bd325e316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:59.280222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1180/2356] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:28:59.290478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:59.291877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:59.349250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f15216-f6c5-40fe-98f7-695814f9edc0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:59.352802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a164ed7-34ea-4861-bf32-d0145bc1d112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:59.353478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a164ed7-34ea-4861-bf32-d0145bc1d112 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:59.353758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a164ed7-34ea-4861-bf32-d0145bc1d112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:59.354030 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a164ed7-34ea-4861-bf32-d0145bc1d112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:59.363186 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a164ed7-34ea-4861-bf32-d0145bc1d112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:59.364674 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a164ed7-34ea-4861-bf32-d0145bc1d112 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:59.374558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1177/2357] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:28:59.771996 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c129fb-9be9-4e55-8325-c0bd325e316c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:28:59.773586 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-60c129fb-9be9-4e55-8325-c0bd325e316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:28:59.786180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c129fb-9be9-4e55-8325-c0bd325e316c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:28:59.791345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:28:59.792201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:28:59.792478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:28:59.792742 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] PATH_INFO: `/v3/projects/50cf55f1268f41a1a114e2e3602b92af` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:28:59.793975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cf55f1268f41a1a114e2e3602b92af)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:28:59.810449 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:28:59.931969 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cf55f1268f41a1a114e2e3602b92af', 'request_id': 'req-2e0a7510-47f1-4363-a489-307c2ce179c6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:00.000131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cf55f1268f41a1a114e2e3602b92af', 'request_id': 'req-2e0a7510-47f1-4363-a489-307c2ce179c6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:00.007938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cf55f1268f41a1a114e2e3602b92af', 'request_id': 'req-2e0a7510-47f1-4363-a489-307c2ce179c6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:00.018429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] The token cache is being invalidate because project 50cf55f1268f41a1a114e2e3602b92af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:29:00.018720 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:00.019386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2e0a7510-47f1-4363-a489-307c2ce179c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:00.021165 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1181/2358] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:28:59 2022] DELETE /identity/v3/projects/50cf55f1268f41a1a114e2e3602b92af => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:29:00.026112 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3412-fad7-4222-ad41-85c26df1030f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:00.026571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3412-fad7-4222-ad41-85c26df1030f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:00.026661 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3412-fad7-4222-ad41-85c26df1030f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:00.044389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-792f3412-fad7-4222-ad41-85c26df1030f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:29:00.045619 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-792f3412-fad7-4222-ad41-85c26df1030f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:00.103556 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1178/2359] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:29:00.111551 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b065-9810-4867-8b3f-736497e8b07c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:00.111846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b065-9810-4867-8b3f-736497e8b07c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:00.112151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b065-9810-4867-8b3f-736497e8b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:00.130760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b4b7b065-9810-4867-8b3f-736497e8b07c None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:29:00.131980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b4b7b065-9810-4867-8b3f-736497e8b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:00.139984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1182/2360] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:29:00.144240 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f3412-fad7-4222-ad41-85c26df1030f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:00.154145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f3412-fad7-4222-ad41-85c26df1030f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:00.158644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01af9a1-c26b-4029-bdc7-182dbd115254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:00.159294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af9a1-c26b-4029-bdc7-182dbd115254 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:00.159577 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af9a1-c26b-4029-bdc7-182dbd115254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:00.159855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af9a1-c26b-4029-bdc7-182dbd115254 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:00.161236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01af9a1-c26b-4029-bdc7-182dbd115254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:29:00.161629 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01af9a1-c26b-4029-bdc7-182dbd115254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:00.163225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01af9a1-c26b-4029-bdc7-182dbd115254 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:00.174526 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1179/2361] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:29:00.179643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7b065-9810-4867-8b3f-736497e8b07c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:00.188826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7b065-9810-4867-8b3f-736497e8b07c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:00.193619 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b0ce4-688a-4e0f-aee0-b3aaca104bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:00.194283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0ce4-688a-4e0f-aee0-b3aaca104bea admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:00.194567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0ce4-688a-4e0f-aee0-b3aaca104bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:00.194843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0ce4-688a-4e0f-aee0-b3aaca104bea admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:00.195805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b0ce4-688a-4e0f-aee0-b3aaca104bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:00.197766 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b0ce4-688a-4e0f-aee0-b3aaca104bea admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:00.331481 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1183/2362] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:29:00 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:29:00.336242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01af9a1-c26b-4029-bdc7-182dbd115254 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:00.346212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01af9a1-c26b-4029-bdc7-182dbd115254 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:00.401404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308e941-b1a5-4cd0-a5cd-6150c3ce9b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:00.402072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308e941-b1a5-4cd0-a5cd-6150c3ce9b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:00.402359 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308e941-b1a5-4cd0-a5cd-6150c3ce9b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:00.402639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308e941-b1a5-4cd0-a5cd-6150c3ce9b40 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:00.403320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308e941-b1a5-4cd0-a5cd-6150c3ce9b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:00.405259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308e941-b1a5-4cd0-a5cd-6150c3ce9b40 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:00.518958 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1180/2363] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:29:00 2022] POST /identity/v3/users => generated 282 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:29:00.524293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b0ce4-688a-4e0f-aee0-b3aaca104bea admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:00.534467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b0ce4-688a-4e0f-aee0-b3aaca104bea admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:00.539666 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf6c71-ea50-4347-8850-86fe70f6d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:00.540323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf6c71-ea50-4347-8850-86fe70f6d4df admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:00.540600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf6c71-ea50-4347-8850-86fe70f6d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:00.540874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf6c71-ea50-4347-8850-86fe70f6d4df admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:00.541632 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf6c71-ea50-4347-8850-86fe70f6d4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:00.543224 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf6c71-ea50-4347-8850-86fe70f6d4df admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:00.553402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1184/2364] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:29:00.557593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308e941-b1a5-4cd0-a5cd-6150c3ce9b40 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:00.567844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308e941-b1a5-4cd0-a5cd-6150c3ce9b40 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:00.572891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a97406-9a16-4bc9-b370-b87bbf59c421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:00.573576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97406-9a16-4bc9-b370-b87bbf59c421 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:00.573860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97406-9a16-4bc9-b370-b87bbf59c421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:00.574138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97406-9a16-4bc9-b370-b87bbf59c421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:00.574859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a97406-9a16-4bc9-b370-b87bbf59c421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:00.576465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a97406-9a16-4bc9-b370-b87bbf59c421 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:00.586901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1181/2365] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:29:00.590958 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf6c71-ea50-4347-8850-86fe70f6d4df admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:00.601723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf6c71-ea50-4347-8850-86fe70f6d4df admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:00.606410 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655f7a7-8ed0-4f19-8668-c48eebdd4871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:00.607275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655f7a7-8ed0-4f19-8668-c48eebdd4871 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:00.607556 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655f7a7-8ed0-4f19-8668-c48eebdd4871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:00.607829 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655f7a7-8ed0-4f19-8668-c48eebdd4871 admin admin] PATH_INFO: `/v3/projects/07bb5d4d306944a29a3c3429c2ff55c0/users/8292d62af48a444791f39c46d72405bc/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:00.622339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655f7a7-8ed0-4f19-8668-c48eebdd4871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bb5d4d306944a29a3c3429c2ff55c0, user_id=8292d62af48a444791f39c46d72405bc, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:00.625031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655f7a7-8ed0-4f19-8668-c48eebdd4871 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:00.749296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1185/2366] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:29:00 2022] PUT /identity/v3/projects/07bb5d4d306944a29a3c3429c2ff55c0/users/8292d62af48a444791f39c46d72405bc/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:29:00.761207 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba838e63-00af-48d0-b0dc-6703862bf688 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:00.761532 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba838e63-00af-48d0-b0dc-6703862bf688 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:00.761838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba838e63-00af-48d0-b0dc-6703862bf688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:00.788887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ba838e63-00af-48d0-b0dc-6703862bf688 None None] MFA Rules not processed for user `8292d62af48a444791f39c46d72405bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:29:00.790145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ba838e63-00af-48d0-b0dc-6703862bf688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:00.853077 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1182/2367] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:29:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:29:00.864394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655f7a7-8ed0-4f19-8668-c48eebdd4871 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:00.866160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f655f7a7-8ed0-4f19-8668-c48eebdd4871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:00.920569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655f7a7-8ed0-4f19-8668-c48eebdd4871 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:00.924254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164ef66-0a12-4f91-a847-111f9c4add09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:00.924893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ef66-0a12-4f91-a847-111f9c4add09 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:00.925208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ef66-0a12-4f91-a847-111f9c4add09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:00.925518 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ef66-0a12-4f91-a847-111f9c4add09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:00.934063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164ef66-0a12-4f91-a847-111f9c4add09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:00.935484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164ef66-0a12-4f91-a847-111f9c4add09 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:00.944707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1186/2368] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:29:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:29:29.430413 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e6dbc-a8ad-4461-b7b8-504cc53b7296 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:29.431016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e6dbc-a8ad-4461-b7b8-504cc53b7296 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:29.431016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e6dbc-a8ad-4461-b7b8-504cc53b7296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:29.452300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-839e6dbc-a8ad-4461-b7b8-504cc53b7296 None None] MFA Rules not processed for user `fa49364b644f4beb9a1e9df859f20a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:29:29.453530 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-839e6dbc-a8ad-4461-b7b8-504cc53b7296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:29.519657 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1183/2369] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:29:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:29:47.648245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298768ba-4312-435e-bbee-97da2b6f3727 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:47.648792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298768ba-4312-435e-bbee-97da2b6f3727 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:47.648792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298768ba-4312-435e-bbee-97da2b6f3727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:47.666811 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-298768ba-4312-435e-bbee-97da2b6f3727 None None] MFA Rules not processed for user `764047899a7f46569e12e14dda41b30d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:29:47.668017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-298768ba-4312-435e-bbee-97da2b6f3727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:47.745867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1187/2370] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:29:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:29:47.998554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e6dbc-a8ad-4461-b7b8-504cc53b7296 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:48.062356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e6dbc-a8ad-4461-b7b8-504cc53b7296 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:48.067220 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:48.068529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:48.068806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:48.069223 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] PATH_INFO: `/v3/users/8292d62af48a444791f39c46d72405bc` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:48.070576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8292d62af48a444791f39c46d72405bc)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:48.072861 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:48.390221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8292d62af48a444791f39c46d72405bc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:48.402245 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8292d62af48a444791f39c46d72405bc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:48.570739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8292d62af48a444791f39c46d72405bc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:48.581042 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8292d62af48a444791f39c46d72405bc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:48.584839 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8292d62af48a444791f39c46d72405bc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:48.596011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1184/2371] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:29:47 2022] DELETE /identity/v3/users/8292d62af48a444791f39c46d72405bc => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:29:48.606219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51e1ed-d648-43e3-8a15-236215ea0ca5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:48.607041 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51e1ed-d648-43e3-8a15-236215ea0ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:48.607503 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51e1ed-d648-43e3-8a15-236215ea0ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:48.655350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5a51e1ed-d648-43e3-8a15-236215ea0ca5 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:29:48.656766 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5a51e1ed-d648-43e3-8a15-236215ea0ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:48.760128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1188/2372] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:29:48.769290 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:48.771461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:48.838866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fc26-e590-4950-bac7-f7764edad925 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:48.842234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1071c5-8d19-413f-8bfe-080b9305bd09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:48.842916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1071c5-8d19-413f-8bfe-080b9305bd09 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:48.843224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1071c5-8d19-413f-8bfe-080b9305bd09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:48.843526 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1071c5-8d19-413f-8bfe-080b9305bd09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:48.853750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1071c5-8d19-413f-8bfe-080b9305bd09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:48.855188 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1071c5-8d19-413f-8bfe-080b9305bd09 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:48.864827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1185/2373] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:29:49.430842 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51e1ed-d648-43e3-8a15-236215ea0ca5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:49.434600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5a51e1ed-d648-43e3-8a15-236215ea0ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:49.445609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51e1ed-d648-43e3-8a15-236215ea0ca5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:49.451418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:49.452285 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:49.452569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:49.452845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] PATH_INFO: `/v3/projects/07bb5d4d306944a29a3c3429c2ff55c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:49.454884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bb5d4d306944a29a3c3429c2ff55c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:49.456831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:49.625018 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bb5d4d306944a29a3c3429c2ff55c0', 'request_id': 'req-819d5e67-3ea6-42a4-b96b-b5543f35b07a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:49.760947 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bb5d4d306944a29a3c3429c2ff55c0', 'request_id': 'req-819d5e67-3ea6-42a4-b96b-b5543f35b07a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:49.768185 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bb5d4d306944a29a3c3429c2ff55c0', 'request_id': 'req-819d5e67-3ea6-42a4-b96b-b5543f35b07a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:49.780691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] The token cache is being invalidate because project 07bb5d4d306944a29a3c3429c2ff55c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:29:49.781011 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:49.781674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-819d5e67-3ea6-42a4-b96b-b5543f35b07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:29:49.785704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1189/2374] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:29:49 2022] DELETE /identity/v3/projects/07bb5d4d306944a29a3c3429c2ff55c0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:29:49.790436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2d564-a058-42cd-837f-c784ad0969f4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:49.790949 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2d564-a058-42cd-837f-c784ad0969f4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:49.791070 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2d564-a058-42cd-837f-c784ad0969f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:49.808863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e1e2d564-a058-42cd-837f-c784ad0969f4 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:29:49.810099 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e1e2d564-a058-42cd-837f-c784ad0969f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:49.869287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1186/2375] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:29:49.877373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62fb31-2cf9-4dcb-9caa-a8d00e7b4c46 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:49.877656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62fb31-2cf9-4dcb-9caa-a8d00e7b4c46 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:49.877930 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62fb31-2cf9-4dcb-9caa-a8d00e7b4c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:49.896449 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1d62fb31-2cf9-4dcb-9caa-a8d00e7b4c46 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:29:49.897680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1d62fb31-2cf9-4dcb-9caa-a8d00e7b4c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:49.905516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1190/2376] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:29:49.920493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2d564-a058-42cd-837f-c784ad0969f4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:49.930084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2d564-a058-42cd-837f-c784ad0969f4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:49.934629 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9360d7-e4dc-4a6f-9dbf-24abc4e7c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:49.935304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9360d7-e4dc-4a6f-9dbf-24abc4e7c5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:49.935585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9360d7-e4dc-4a6f-9dbf-24abc4e7c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:49.935862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9360d7-e4dc-4a6f-9dbf-24abc4e7c5ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:49.936581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9360d7-e4dc-4a6f-9dbf-24abc4e7c5ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:29:49.936905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9360d7-e4dc-4a6f-9dbf-24abc4e7c5ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:49.938521 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9360d7-e4dc-4a6f-9dbf-24abc4e7c5ea admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:49.950738 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1187/2377] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:29:49.955109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62fb31-2cf9-4dcb-9caa-a8d00e7b4c46 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:49.966110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62fb31-2cf9-4dcb-9caa-a8d00e7b4c46 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:49.971032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538163c-f578-424e-96cc-7e03c8f53dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:49.971684 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538163c-f578-424e-96cc-7e03c8f53dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:49.971959 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538163c-f578-424e-96cc-7e03c8f53dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:49.972230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538163c-f578-424e-96cc-7e03c8f53dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:49.972918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538163c-f578-424e-96cc-7e03c8f53dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:49.975291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538163c-f578-424e-96cc-7e03c8f53dc8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:50.152828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1191/2378] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:29:49 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:29:50.156908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9360d7-e4dc-4a6f-9dbf-24abc4e7c5ea admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:50.166981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9360d7-e4dc-4a6f-9dbf-24abc4e7c5ea admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:50.223259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd957c0-85b2-4ec1-92f5-7e3b77240956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:50.223963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd957c0-85b2-4ec1-92f5-7e3b77240956 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:50.224426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd957c0-85b2-4ec1-92f5-7e3b77240956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:50.224706 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd957c0-85b2-4ec1-92f5-7e3b77240956 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:50.225445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd957c0-85b2-4ec1-92f5-7e3b77240956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:50.227362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd957c0-85b2-4ec1-92f5-7e3b77240956 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:50.356205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1188/2379] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:29:50 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:29:50.360438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538163c-f578-424e-96cc-7e03c8f53dc8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:50.371700 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538163c-f578-424e-96cc-7e03c8f53dc8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:50.376291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3092a0-ab66-4f9d-8761-e6c941e6893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:50.376952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3092a0-ab66-4f9d-8761-e6c941e6893b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:50.377254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3092a0-ab66-4f9d-8761-e6c941e6893b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:50.377525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3092a0-ab66-4f9d-8761-e6c941e6893b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:50.378240 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3092a0-ab66-4f9d-8761-e6c941e6893b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:50.379842 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3092a0-ab66-4f9d-8761-e6c941e6893b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:50.390943 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1192/2380] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:29:50.394764 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd957c0-85b2-4ec1-92f5-7e3b77240956 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:50.404778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd957c0-85b2-4ec1-92f5-7e3b77240956 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:50.409217 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5257705-5a12-45fa-bfef-7d085f07687f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:50.410007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5257705-5a12-45fa-bfef-7d085f07687f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:50.410286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5257705-5a12-45fa-bfef-7d085f07687f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:50.410560 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5257705-5a12-45fa-bfef-7d085f07687f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:50.411985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5257705-5a12-45fa-bfef-7d085f07687f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:50.413618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5257705-5a12-45fa-bfef-7d085f07687f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:50.423566 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1189/2381] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:29:50.428569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3092a0-ab66-4f9d-8761-e6c941e6893b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:50.438490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3092a0-ab66-4f9d-8761-e6c941e6893b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:50.443880 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a020dfb-5eb4-449d-9f0f-d83ed3a9f557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:50.444638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a020dfb-5eb4-449d-9f0f-d83ed3a9f557 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:50.444918 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a020dfb-5eb4-449d-9f0f-d83ed3a9f557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:50.445226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a020dfb-5eb4-449d-9f0f-d83ed3a9f557 admin admin] PATH_INFO: `/v3/projects/47cdab1e9b464fd2974ee31d4ab20865/users/590232e0efa742f1a4c273259fd2531b/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:50.461451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a020dfb-5eb4-449d-9f0f-d83ed3a9f557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cdab1e9b464fd2974ee31d4ab20865, user_id=590232e0efa742f1a4c273259fd2531b, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:50.463555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a020dfb-5eb4-449d-9f0f-d83ed3a9f557 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:50.573585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1193/2382] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:29:50 2022] PUT /identity/v3/projects/47cdab1e9b464fd2974ee31d4ab20865/users/590232e0efa742f1a4c273259fd2531b/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:29:50.578622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448c86-3b28-4c69-bc7f-798492ad85d7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:50.578914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448c86-3b28-4c69-bc7f-798492ad85d7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:50.579196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448c86-3b28-4c69-bc7f-798492ad85d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:50.596795 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-75448c86-3b28-4c69-bc7f-798492ad85d7 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:29:50.598054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-75448c86-3b28-4c69-bc7f-798492ad85d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:50.664759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1190/2383] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:29:50.671592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a020dfb-5eb4-449d-9f0f-d83ed3a9f557 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:50.673697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6a020dfb-5eb4-449d-9f0f-d83ed3a9f557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:50.730634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a020dfb-5eb4-449d-9f0f-d83ed3a9f557 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:50.734263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50f1fc-cbe7-4743-8214-bd704f21da2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:50.734904 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f1fc-cbe7-4743-8214-bd704f21da2b service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:50.741692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f1fc-cbe7-4743-8214-bd704f21da2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:50.741692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f1fc-cbe7-4743-8214-bd704f21da2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:50.745282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50f1fc-cbe7-4743-8214-bd704f21da2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:50.746712 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50f1fc-cbe7-4743-8214-bd704f21da2b service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:50.756058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1194/2384] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:29:57.442202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3ae09-e3bf-4dda-9b0b-1f0ded4f79af None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:57.442893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3ae09-e3bf-4dda-9b0b-1f0ded4f79af None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:57.442893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3ae09-e3bf-4dda-9b0b-1f0ded4f79af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:57.478123 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0db3ae09-e3bf-4dda-9b0b-1f0ded4f79af None None] MFA Rules not processed for user `590232e0efa742f1a4c273259fd2531b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:29:57.479671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0db3ae09-e3bf-4dda-9b0b-1f0ded4f79af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:29:57.559222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1191/2385] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:29:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:29:57.564519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50f1fc-cbe7-4743-8214-bd704f21da2b service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:57.576788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50f1fc-cbe7-4743-8214-bd704f21da2b service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:57.582176 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a599b-d64f-44a5-b8a5-c00897949a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:57.582998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a599b-d64f-44a5-b8a5-c00897949a54 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:57.583320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a599b-d64f-44a5-b8a5-c00897949a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:57.583586 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a599b-d64f-44a5-b8a5-c00897949a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:57.584569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a599b-d64f-44a5-b8a5-c00897949a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:57.586548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a599b-d64f-44a5-b8a5-c00897949a54 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:57.860467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1195/2386] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:29:57 2022] POST /identity/v3/projects => generated 379 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:29:57.865248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3ae09-e3bf-4dda-9b0b-1f0ded4f79af None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:57.876028 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3ae09-e3bf-4dda-9b0b-1f0ded4f79af None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:57.932504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2b88-6cc0-465a-ace1-2a8213a5edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:57.933210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2b88-6cc0-465a-ace1-2a8213a5edff admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:57.933494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2b88-6cc0-465a-ace1-2a8213a5edff admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:57.933767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2b88-6cc0-465a-ace1-2a8213a5edff admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:57.934449 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e2b88-6cc0-465a-ace1-2a8213a5edff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:57.936324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e2b88-6cc0-465a-ace1-2a8213a5edff admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:58.084619 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1192/2387] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:29:57 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:29:58.085863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a599b-d64f-44a5-b8a5-c00897949a54 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:58.095951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a599b-d64f-44a5-b8a5-c00897949a54 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:58.103020 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3aebe-af83-47a9-a32f-c07b4b6516bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:58.103681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3aebe-af83-47a9-a32f-c07b4b6516bf admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:58.103984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3aebe-af83-47a9-a32f-c07b4b6516bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:58.104257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3aebe-af83-47a9-a32f-c07b4b6516bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:58.105003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3aebe-af83-47a9-a32f-c07b4b6516bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:58.106611 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3aebe-af83-47a9-a32f-c07b4b6516bf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:58.121667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1196/2388] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:29:58.122811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2b88-6cc0-465a-ace1-2a8213a5edff admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:58.133394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2b88-6cc0-465a-ace1-2a8213a5edff admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:58.138109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a0681-4330-4e21-98ff-e2dbd40706d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:58.138989 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a0681-4330-4e21-98ff-e2dbd40706d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:58.139267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a0681-4330-4e21-98ff-e2dbd40706d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:58.139536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a0681-4330-4e21-98ff-e2dbd40706d5 admin admin] PATH_INFO: `/v3/projects/214c698cc01e4477812b4655b70a1d4b/users/134aa8ad42c647fe9f1547fbb2eb520c/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:58.158331 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a0681-4330-4e21-98ff-e2dbd40706d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214c698cc01e4477812b4655b70a1d4b, user_id=134aa8ad42c647fe9f1547fbb2eb520c, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:58.162297 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a0681-4330-4e21-98ff-e2dbd40706d5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:58.388001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1193/2389] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:29:58 2022] PUT /identity/v3/projects/214c698cc01e4477812b4655b70a1d4b/users/134aa8ad42c647fe9f1547fbb2eb520c/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:29:58.389246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3aebe-af83-47a9-a32f-c07b4b6516bf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:58.389246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3aebe-af83-47a9-a32f-c07b4b6516bf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:58.430510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca9290-2e5c-4c57-9191-f790cd45d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:58.431204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9290-2e5c-4c57-9191-f790cd45d731 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:58.431489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9290-2e5c-4c57-9191-f790cd45d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:58.431766 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9290-2e5c-4c57-9191-f790cd45d731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:58.432488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca9290-2e5c-4c57-9191-f790cd45d731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:58.434136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca9290-2e5c-4c57-9191-f790cd45d731 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:58.444092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1197/2390] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:29:58.464205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a0681-4330-4e21-98ff-e2dbd40706d5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:29:58.475790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a0681-4330-4e21-98ff-e2dbd40706d5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:29:58.481412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51068d7f-787c-41e1-8384-ea7a10da1787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:29:58.482480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068d7f-787c-41e1-8384-ea7a10da1787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:29:58.482922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068d7f-787c-41e1-8384-ea7a10da1787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:29:58.483343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068d7f-787c-41e1-8384-ea7a10da1787 admin admin] PATH_INFO: `/v3/projects/214c698cc01e4477812b4655b70a1d4b/users/134aa8ad42c647fe9f1547fbb2eb520c/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:29:58.485582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51068d7f-787c-41e1-8384-ea7a10da1787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214c698cc01e4477812b4655b70a1d4b, user_id=134aa8ad42c647fe9f1547fbb2eb520c, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:29:58.488245 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51068d7f-787c-41e1-8384-ea7a10da1787 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:29:58.499425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1194/2391] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:29:58 2022] PUT /identity/v3/projects/214c698cc01e4477812b4655b70a1d4b/users/134aa8ad42c647fe9f1547fbb2eb520c/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:30:05.716510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fed69-33c1-4133-b812-fbe57c3290f6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:30:05.717111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fed69-33c1-4133-b812-fbe57c3290f6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:30:05.717111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fed69-33c1-4133-b812-fbe57c3290f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:30:05.755374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e39fed69-33c1-4133-b812-fbe57c3290f6 None None] MFA Rules not processed for user `134aa8ad42c647fe9f1547fbb2eb520c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:30:05.758041 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e39fed69-33c1-4133-b812-fbe57c3290f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:05.846181 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1198/2392] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:30:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:30:05.859475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51068d7f-787c-41e1-8384-ea7a10da1787 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:30:05.860095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-51068d7f-787c-41e1-8384-ea7a10da1787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:05.945503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51068d7f-787c-41e1-8384-ea7a10da1787 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:30:05.951282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dab8dd-0464-4d9c-8895-103c5d92872c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:30:05.953680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dab8dd-0464-4d9c-8895-103c5d92872c service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:30:05.953680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dab8dd-0464-4d9c-8895-103c5d92872c service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:30:05.953680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dab8dd-0464-4d9c-8895-103c5d92872c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:30:06.011252 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dab8dd-0464-4d9c-8895-103c5d92872c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:30:06.012778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dab8dd-0464-4d9c-8895-103c5d92872c service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:30:06.028444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1195/2393] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:30:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:30:15.374307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46490f-5a4f-4a07-a5c5-bab3d477dd51 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:30:15.375119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46490f-5a4f-4a07-a5c5-bab3d477dd51 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:30:15.375338 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46490f-5a4f-4a07-a5c5-bab3d477dd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:30:15.398312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-df46490f-5a4f-4a07-a5c5-bab3d477dd51 None None] MFA Rules not processed for user `6388423ccb4f44a0981a8b994fd222ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:30:15.400232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-df46490f-5a4f-4a07-a5c5-bab3d477dd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:15.490790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1199/2394] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:30:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:30:27.284095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbaeb3-1c5a-4a0e-9873-003fe8f1a2b6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:30:27.284615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbaeb3-1c5a-4a0e-9873-003fe8f1a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:30:27.284725 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbaeb3-1c5a-4a0e-9873-003fe8f1a2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:30:27.304423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1bfbaeb3-1c5a-4a0e-9873-003fe8f1a2b6 None None] MFA Rules not processed for user `590232e0efa742f1a4c273259fd2531b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:30:27.305680 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1bfbaeb3-1c5a-4a0e-9873-003fe8f1a2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:27.313322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1196/2395] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:30:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:30:41.042733 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd083f4-287f-4e65-97ff-4589e708253c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:30:41.043343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd083f4-287f-4e65-97ff-4589e708253c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:30:41.043343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd083f4-287f-4e65-97ff-4589e708253c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:30:41.060992 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2bd083f4-287f-4e65-97ff-4589e708253c None None] MFA Rules not processed for user `ceb69d85e1f24983aa9de1557e468494`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:30:41.062297 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2bd083f4-287f-4e65-97ff-4589e708253c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:41.120207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1200/2396] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:30:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:30:42.205774 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbaeb3-1c5a-4a0e-9873-003fe8f1a2b6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:30:42.207852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1bfbaeb3-1c5a-4a0e-9873-003fe8f1a2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:42.266101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbaeb3-1c5a-4a0e-9873-003fe8f1a2b6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:30:42.270319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8dfe3-2a7c-4340-a22c-eee69d889f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:30:42.271860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8dfe3-2a7c-4340-a22c-eee69d889f8d service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:30:42.272142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8dfe3-2a7c-4340-a22c-eee69d889f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:30:42.272415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8dfe3-2a7c-4340-a22c-eee69d889f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:30:42.274281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-16d8dfe3-2a7c-4340-a22c-eee69d889f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:42.290718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8dfe3-2a7c-4340-a22c-eee69d889f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:30:42.292180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8dfe3-2a7c-4340-a22c-eee69d889f8d service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:30:42.304096 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1197/2397] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:30:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:30:42.790284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd083f4-287f-4e65-97ff-4589e708253c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:30:42.799786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd083f4-287f-4e65-97ff-4589e708253c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:30:42.804164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8e31e-5893-4db2-8c07-f72b4a72140d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:30:42.804807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8e31e-5893-4db2-8c07-f72b4a72140d service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:30:42.805120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8e31e-5893-4db2-8c07-f72b4a72140d service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:30:42.805398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8e31e-5893-4db2-8c07-f72b4a72140d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:30:42.807197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1de8e31e-5893-4db2-8c07-f72b4a72140d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:42.821713 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8e31e-5893-4db2-8c07-f72b4a72140d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:30:42.823443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8e31e-5893-4db2-8c07-f72b4a72140d service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:30:42.835594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1201/2398] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:30:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:30:43.746941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8dfe3-2a7c-4340-a22c-eee69d889f8d service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:30:43.748422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-16d8dfe3-2a7c-4340-a22c-eee69d889f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:43.811971 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8dfe3-2a7c-4340-a22c-eee69d889f8d service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:30:43.816422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:30:43.817320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:30:43.817708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:30:43.817983 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] PATH_INFO: `/v3/users/fa49364b644f4beb9a1e9df859f20a8f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:30:43.819170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa49364b644f4beb9a1e9df859f20a8f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:30:43.821108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:30:44.003180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa49364b644f4beb9a1e9df859f20a8f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:30:44.015635 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa49364b644f4beb9a1e9df859f20a8f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:30:44.086704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa49364b644f4beb9a1e9df859f20a8f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:30:44.093747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa49364b644f4beb9a1e9df859f20a8f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:30:44.094417 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa49364b644f4beb9a1e9df859f20a8f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:30:44.103626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1198/2399] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:30:43 2022] DELETE /identity/v3/users/fa49364b644f4beb9a1e9df859f20a8f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:30:44.372201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8e31e-5893-4db2-8c07-f72b4a72140d service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:30:44.384846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8e31e-5893-4db2-8c07-f72b4a72140d service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:30:44.441375 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:30:44.442843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:30:44.443121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:30:44.443395 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] PATH_INFO: `/v3/projects/d09d16c1614c4715a121f402aeaa024f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:30:44.444598 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09d16c1614c4715a121f402aeaa024f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:30:44.446519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:30:44.593321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09d16c1614c4715a121f402aeaa024f', 'request_id': 'req-fe693604-9ab4-4e3f-bc25-c8313a24d062'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:30:44.692995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09d16c1614c4715a121f402aeaa024f', 'request_id': 'req-fe693604-9ab4-4e3f-bc25-c8313a24d062'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:30:44.700325 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09d16c1614c4715a121f402aeaa024f', 'request_id': 'req-fe693604-9ab4-4e3f-bc25-c8313a24d062'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:30:44.711102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] The token cache is being invalidate because project d09d16c1614c4715a121f402aeaa024f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:30:44.711384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:30:44.712038 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:30:44.713841 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1202/2400] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:30:44 2022] DELETE /identity/v3/projects/d09d16c1614c4715a121f402aeaa024f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:30:51.161028 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:30:51.162595 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:51.218370 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1aba0-8cbf-4f3c-ba82-dbda50abba30 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:30:51.265746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7506fc6-6feb-402a-8345-f0199af2b13c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:30:51.266393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7506fc6-6feb-402a-8345-f0199af2b13c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:30:51.266674 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7506fc6-6feb-402a-8345-f0199af2b13c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:30:51.266947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7506fc6-6feb-402a-8345-f0199af2b13c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:30:51.268713 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a7506fc6-6feb-402a-8345-f0199af2b13c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:51.329574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7506fc6-6feb-402a-8345-f0199af2b13c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:30:51.331057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7506fc6-6feb-402a-8345-f0199af2b13c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:30:51.341126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1199/2401] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:30:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:30:53.572160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:30:53.572908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:53.631456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe693604-9ab4-4e3f-bc25-c8313a24d062 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:30:53.635061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd38d-a9e0-4b26-b5d6-88e7ee1b574a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:30:53.635688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd38d-a9e0-4b26-b5d6-88e7ee1b574a service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:30:53.635972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd38d-a9e0-4b26-b5d6-88e7ee1b574a service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:30:53.636248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd38d-a9e0-4b26-b5d6-88e7ee1b574a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:30:53.638090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-072bd38d-a9e0-4b26-b5d6-88e7ee1b574a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:30:53.704585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bd38d-a9e0-4b26-b5d6-88e7ee1b574a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:30:53.710679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bd38d-a9e0-4b26-b5d6-88e7ee1b574a service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:30:53.721860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1203/2402] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:30:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:31:05.948005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7506fc6-6feb-402a-8345-f0199af2b13c service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:05.949829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a7506fc6-6feb-402a-8345-f0199af2b13c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:06.027840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7506fc6-6feb-402a-8345-f0199af2b13c service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:06.033596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9635b-c60f-458a-9f76-e338881d64dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:06.034258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9635b-c60f-458a-9f76-e338881d64dd service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:06.034540 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9635b-c60f-458a-9f76-e338881d64dd service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:06.034852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9635b-c60f-458a-9f76-e338881d64dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:06.037941 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-45d9635b-c60f-458a-9f76-e338881d64dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:06.053681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9635b-c60f-458a-9f76-e338881d64dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:06.060414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9635b-c60f-458a-9f76-e338881d64dd service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:06.068010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1200/2403] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:31:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:31:11.777663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9e4e9-ad5a-4a9a-89f1-1e4307d53be5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:11.783177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9e4e9-ad5a-4a9a-89f1-1e4307d53be5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:11.783177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9e4e9-ad5a-4a9a-89f1-1e4307d53be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:11.795735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-23e9e4e9-ad5a-4a9a-89f1-1e4307d53be5 None None] MFA Rules not processed for user `764047899a7f46569e12e14dda41b30d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:31:11.797609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-23e9e4e9-ad5a-4a9a-89f1-1e4307d53be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:11.805326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1204/2404] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:31:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:31:12.350064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9635b-c60f-458a-9f76-e338881d64dd service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:12.352208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-45d9635b-c60f-458a-9f76-e338881d64dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:12.364456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9635b-c60f-458a-9f76-e338881d64dd service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:12.368229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397674d-3134-4a11-af54-4142c92119eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:12.368876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397674d-3134-4a11-af54-4142c92119eb service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:12.369186 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397674d-3134-4a11-af54-4142c92119eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:12.369465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397674d-3134-4a11-af54-4142c92119eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:12.371211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2397674d-3134-4a11-af54-4142c92119eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:12.381008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397674d-3134-4a11-af54-4142c92119eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:12.382422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397674d-3134-4a11-af54-4142c92119eb service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:12.390181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1201/2405] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:31:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:31:12.869608 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9e4e9-ad5a-4a9a-89f1-1e4307d53be5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:12.871049 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-23e9e4e9-ad5a-4a9a-89f1-1e4307d53be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:12.942213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9e4e9-ad5a-4a9a-89f1-1e4307d53be5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:12.947414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186ac44-de78-449a-a3ca-075248a2e1dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7095f3ab8545c589d4d28a846ba1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:12.948077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ac44-de78-449a-a3ca-075248a2e1dd service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:12.948368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ac44-de78-449a-a3ca-075248a2e1dd service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:12.948646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ac44-de78-449a-a3ca-075248a2e1dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:12.950750 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c186ac44-de78-449a-a3ca-075248a2e1dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:12.963595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186ac44-de78-449a-a3ca-075248a2e1dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:12.965543 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186ac44-de78-449a-a3ca-075248a2e1dd service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:12.977327 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1205/2406] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:31:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:31:16.025598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397674d-3134-4a11-af54-4142c92119eb service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:16.027205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2397674d-3134-4a11-af54-4142c92119eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:16.040853 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397674d-3134-4a11-af54-4142c92119eb service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:16.044694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5296b0e-04bf-4611-9a46-7e1e410b7acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:16.045380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5296b0e-04bf-4611-9a46-7e1e410b7acd service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:16.045664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5296b0e-04bf-4611-9a46-7e1e410b7acd service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:16.045940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5296b0e-04bf-4611-9a46-7e1e410b7acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:16.047716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f5296b0e-04bf-4611-9a46-7e1e410b7acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:16.058202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5296b0e-04bf-4611-9a46-7e1e410b7acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:16.059617 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5296b0e-04bf-4611-9a46-7e1e410b7acd service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:16.068093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1202/2407] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:31:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:31:16.124809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186ac44-de78-449a-a3ca-075248a2e1dd service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:16.124809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c186ac44-de78-449a-a3ca-075248a2e1dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:16.139254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186ac44-de78-449a-a3ca-075248a2e1dd service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:16.145184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952166a5-75f3-4639-af2a-7fd4e8870a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:16.146118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952166a5-75f3-4639-af2a-7fd4e8870a76 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:16.146549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952166a5-75f3-4639-af2a-7fd4e8870a76 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:16.146880 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952166a5-75f3-4639-af2a-7fd4e8870a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:16.149089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-952166a5-75f3-4639-af2a-7fd4e8870a76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:16.229730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952166a5-75f3-4639-af2a-7fd4e8870a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:16.231367 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952166a5-75f3-4639-af2a-7fd4e8870a76 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:16.241657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1206/2408] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:31:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:31:24.174289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5296b0e-04bf-4611-9a46-7e1e410b7acd service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:24.184353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5296b0e-04bf-4611-9a46-7e1e410b7acd service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:24.188013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364189fa-047c-4df1-ba92-81d50c20ad2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:24.188665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364189fa-047c-4df1-ba92-81d50c20ad2a service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:24.188938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364189fa-047c-4df1-ba92-81d50c20ad2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:24.189248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364189fa-047c-4df1-ba92-81d50c20ad2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:24.190994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-364189fa-047c-4df1-ba92-81d50c20ad2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:24.249082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364189fa-047c-4df1-ba92-81d50c20ad2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:24.254488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364189fa-047c-4df1-ba92-81d50c20ad2a service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:24.260321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1203/2409] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:31:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:31:24.431748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952166a5-75f3-4639-af2a-7fd4e8870a76 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:24.444160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952166a5-75f3-4639-af2a-7fd4e8870a76 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:24.450147 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5d876-78f1-466a-b2b3-67559bbd51e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:24.450861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5d876-78f1-466a-b2b3-67559bbd51e3 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:24.451150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5d876-78f1-466a-b2b3-67559bbd51e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:24.451421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5d876-78f1-466a-b2b3-67559bbd51e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:24.453336 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-99d5d876-78f1-466a-b2b3-67559bbd51e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:24.466623 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5d876-78f1-466a-b2b3-67559bbd51e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:24.468203 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5d876-78f1-466a-b2b3-67559bbd51e3 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:24.483430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1207/2410] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:31:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:31:29.336757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364189fa-047c-4df1-ba92-81d50c20ad2a service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:29.350853 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364189fa-047c-4df1-ba92-81d50c20ad2a service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:29.357028 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311ee6d-309b-4021-81a5-d99271397ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:29.358176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311ee6d-309b-4021-81a5-d99271397ae0 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:29.358459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311ee6d-309b-4021-81a5-d99271397ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:29.358740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311ee6d-309b-4021-81a5-d99271397ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:29.360593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d311ee6d-309b-4021-81a5-d99271397ae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:29.374717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311ee6d-309b-4021-81a5-d99271397ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:29.376314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311ee6d-309b-4021-81a5-d99271397ae0 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:29.388116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1204/2411] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:31:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:31:39.352345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb5e0a-ddfc-44d4-834c-d94d82d4dd28 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:39.352871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb5e0a-ddfc-44d4-834c-d94d82d4dd28 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:39.352871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb5e0a-ddfc-44d4-834c-d94d82d4dd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:39.372288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-08fb5e0a-ddfc-44d4-834c-d94d82d4dd28 None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:31:39.373513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-08fb5e0a-ddfc-44d4-834c-d94d82d4dd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:39.427815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1208/2412] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:31:39.674823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311ee6d-309b-4021-81a5-d99271397ae0 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:39.676336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d311ee6d-309b-4021-81a5-d99271397ae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:39.744820 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311ee6d-309b-4021-81a5-d99271397ae0 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:39.750162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac2700-669b-4bf7-b1eb-4e8b79f2d00d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:39.750821 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2700-669b-4bf7-b1eb-4e8b79f2d00d service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:39.751125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2700-669b-4bf7-b1eb-4e8b79f2d00d service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:39.751443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2700-669b-4bf7-b1eb-4e8b79f2d00d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:39.760656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac2700-669b-4bf7-b1eb-4e8b79f2d00d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:39.762305 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac2700-669b-4bf7-b1eb-4e8b79f2d00d service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:39.772345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1205/2413] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:31:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 14:31:47.018073 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb5e0a-ddfc-44d4-834c-d94d82d4dd28 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:47.030461 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb5e0a-ddfc-44d4-834c-d94d82d4dd28 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:47.034920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3eca90-0823-423c-9577-4aeb4bbdcbdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:47.035759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eca90-0823-423c-9577-4aeb4bbdcbdd service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:47.036092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eca90-0823-423c-9577-4aeb4bbdcbdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:47.036404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eca90-0823-423c-9577-4aeb4bbdcbdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:47.038442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cc3eca90-0823-423c-9577-4aeb4bbdcbdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:47.120573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3eca90-0823-423c-9577-4aeb4bbdcbdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:47.122073 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3eca90-0823-423c-9577-4aeb4bbdcbdd service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:47.136577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1209/2414] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:31:51.943568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac2700-669b-4bf7-b1eb-4e8b79f2d00d service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:51.945252 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b6ac2700-669b-4bf7-b1eb-4e8b79f2d00d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:51.960430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac2700-669b-4bf7-b1eb-4e8b79f2d00d service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:51.965358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b8ee8-5523-46b1-9326-6612514b6400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:51.966207 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b8ee8-5523-46b1-9326-6612514b6400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:51.966520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b8ee8-5523-46b1-9326-6612514b6400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:51.966797 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b8ee8-5523-46b1-9326-6612514b6400 admin admin] PATH_INFO: `/v3/users/ceb69d85e1f24983aa9de1557e468494` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:51.968018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b8ee8-5523-46b1-9326-6612514b6400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb69d85e1f24983aa9de1557e468494)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:51.970038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b8ee8-5523-46b1-9326-6612514b6400 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:52.123717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6d4b8ee8-5523-46b1-9326-6612514b6400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb69d85e1f24983aa9de1557e468494'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:31:52.135730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6d4b8ee8-5523-46b1-9326-6612514b6400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb69d85e1f24983aa9de1557e468494'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:31:52.212786 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6d4b8ee8-5523-46b1-9326-6612514b6400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb69d85e1f24983aa9de1557e468494'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:31:52.220125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6d4b8ee8-5523-46b1-9326-6612514b6400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb69d85e1f24983aa9de1557e468494'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:31:52.220724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6d4b8ee8-5523-46b1-9326-6612514b6400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb69d85e1f24983aa9de1557e468494'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:31:52.227451 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1206/2415] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:31:51 2022] DELETE /identity/v3/users/ceb69d85e1f24983aa9de1557e468494 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:31:52.486311 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3eca90-0823-423c-9577-4aeb4bbdcbdd service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:52.496293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3eca90-0823-423c-9577-4aeb4bbdcbdd service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:52.553717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:52.554573 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:52.554857 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:52.555135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] PATH_INFO: `/v3/projects/01f26170c3294efc8e2156d7bbf0f995` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:52.556326 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f26170c3294efc8e2156d7bbf0f995)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:52.558288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:52.698127 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f26170c3294efc8e2156d7bbf0f995', 'request_id': 'req-7788f536-0a05-4e0e-8870-875153b04385'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:31:52.760997 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f26170c3294efc8e2156d7bbf0f995', 'request_id': 'req-7788f536-0a05-4e0e-8870-875153b04385'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:31:52.767385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f26170c3294efc8e2156d7bbf0f995', 'request_id': 'req-7788f536-0a05-4e0e-8870-875153b04385'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:31:52.778342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] The token cache is being invalidate because project 01f26170c3294efc8e2156d7bbf0f995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:31:52.778628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:31:52.779385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7788f536-0a05-4e0e-8870-875153b04385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:31:52.780917 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1210/2416] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:31:52 2022] DELETE /identity/v3/projects/01f26170c3294efc8e2156d7bbf0f995 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:31:52.785851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124347-aab9-482b-b541-c9deb07ca3b5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:52.786131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124347-aab9-482b-b541-c9deb07ca3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:52.786406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124347-aab9-482b-b541-c9deb07ca3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:52.803475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6d124347-aab9-482b-b541-c9deb07ca3b5 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:31:52.804701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6d124347-aab9-482b-b541-c9deb07ca3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:52.863196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1207/2417] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:31:52.872280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff08611-f11e-4012-9be0-c032e06737b8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:52.872280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff08611-f11e-4012-9be0-c032e06737b8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:52.872280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff08611-f11e-4012-9be0-c032e06737b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:52.890926 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9ff08611-f11e-4012-9be0-c032e06737b8 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:31:52.892143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9ff08611-f11e-4012-9be0-c032e06737b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:52.900496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1211/2418] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:31:52.904930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124347-aab9-482b-b541-c9deb07ca3b5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:52.915011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124347-aab9-482b-b541-c9deb07ca3b5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:52.919585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f908e0-ce3c-4f34-a8ee-ec86daefcd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:52.920248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f908e0-ce3c-4f34-a8ee-ec86daefcd43 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:52.920530 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f908e0-ce3c-4f34-a8ee-ec86daefcd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:52.920804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f908e0-ce3c-4f34-a8ee-ec86daefcd43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:52.921566 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f908e0-ce3c-4f34-a8ee-ec86daefcd43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:31:52.921874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f908e0-ce3c-4f34-a8ee-ec86daefcd43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:52.923452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f908e0-ce3c-4f34-a8ee-ec86daefcd43 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:52.935730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1208/2419] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:31:52.940120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff08611-f11e-4012-9be0-c032e06737b8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:52.950689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff08611-f11e-4012-9be0-c032e06737b8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:52.956433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210a613-339e-4cc2-bcf7-30e4f9e76bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:52.957142 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210a613-339e-4cc2-bcf7-30e4f9e76bab admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:52.957424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210a613-339e-4cc2-bcf7-30e4f9e76bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:52.957698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210a613-339e-4cc2-bcf7-30e4f9e76bab admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:52.958442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210a613-339e-4cc2-bcf7-30e4f9e76bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:52.960370 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210a613-339e-4cc2-bcf7-30e4f9e76bab admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:53.086765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1212/2420] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:31:52 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:31:53.091379 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f908e0-ce3c-4f34-a8ee-ec86daefcd43 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:53.102584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f908e0-ce3c-4f34-a8ee-ec86daefcd43 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:53.166436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa2496-5f8a-433e-9e84-61e16845af80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:53.167132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa2496-5f8a-433e-9e84-61e16845af80 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:53.167690 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa2496-5f8a-433e-9e84-61e16845af80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:53.168208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa2496-5f8a-433e-9e84-61e16845af80 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:53.169094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa2496-5f8a-433e-9e84-61e16845af80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:53.171701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa2496-5f8a-433e-9e84-61e16845af80 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:53.261794 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1209/2421] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:31:53 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:31:53.265900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210a613-339e-4cc2-bcf7-30e4f9e76bab admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:53.276563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210a613-339e-4cc2-bcf7-30e4f9e76bab admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:53.281234 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805fe35-2f93-412b-a5a5-c8cacb65a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:53.281896 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805fe35-2f93-412b-a5a5-c8cacb65a8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:53.282177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805fe35-2f93-412b-a5a5-c8cacb65a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:53.282453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805fe35-2f93-412b-a5a5-c8cacb65a8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:53.283206 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805fe35-2f93-412b-a5a5-c8cacb65a8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:53.284791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805fe35-2f93-412b-a5a5-c8cacb65a8f9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:53.295142 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1213/2422] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:31:53.299184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa2496-5f8a-433e-9e84-61e16845af80 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:53.309668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa2496-5f8a-433e-9e84-61e16845af80 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:53.314286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb977f-ecb4-494b-b7ae-1f51730c5d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:53.314988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb977f-ecb4-494b-b7ae-1f51730c5d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:53.315269 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb977f-ecb4-494b-b7ae-1f51730c5d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:53.315551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb977f-ecb4-494b-b7ae-1f51730c5d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:53.316281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb977f-ecb4-494b-b7ae-1f51730c5d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:53.318092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb977f-ecb4-494b-b7ae-1f51730c5d86 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:53.328907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1210/2423] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:31:53.333186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805fe35-2f93-412b-a5a5-c8cacb65a8f9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:53.342978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805fe35-2f93-412b-a5a5-c8cacb65a8f9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:53.347483 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d6bf5-d03d-4bf8-b797-6f37e3bdc3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:53.348896 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d6bf5-d03d-4bf8-b797-6f37e3bdc3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:53.349205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d6bf5-d03d-4bf8-b797-6f37e3bdc3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:53.349481 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d6bf5-d03d-4bf8-b797-6f37e3bdc3ca admin admin] PATH_INFO: `/v3/projects/d637e894357c485cb847dcc0b5fd8955/users/0397dbba0a6c42849d021d87e090f7fc/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:53.364330 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d6bf5-d03d-4bf8-b797-6f37e3bdc3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d637e894357c485cb847dcc0b5fd8955, user_id=0397dbba0a6c42849d021d87e090f7fc, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:53.367135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d6bf5-d03d-4bf8-b797-6f37e3bdc3ca admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:53.466425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1214/2424] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:31:53 2022] PUT /identity/v3/projects/d637e894357c485cb847dcc0b5fd8955/users/0397dbba0a6c42849d021d87e090f7fc/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:31:53.477581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37014e82-af2d-4076-9cea-614ad71e791d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:53.477865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37014e82-af2d-4076-9cea-614ad71e791d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:53.478143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37014e82-af2d-4076-9cea-614ad71e791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:53.504728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-37014e82-af2d-4076-9cea-614ad71e791d None None] MFA Rules not processed for user `0397dbba0a6c42849d021d87e090f7fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:31:53.505967 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-37014e82-af2d-4076-9cea-614ad71e791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:53.574094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1211/2425] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:31:53.579050 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d6bf5-d03d-4bf8-b797-6f37e3bdc3ca admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:53.639254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d6bf5-d03d-4bf8-b797-6f37e3bdc3ca admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:53.644401 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a577a-1b03-41a3-99c1-7a75142df6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:53.645708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a577a-1b03-41a3-99c1-7a75142df6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:53.645989 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a577a-1b03-41a3-99c1-7a75142df6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:53.646266 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a577a-1b03-41a3-99c1-7a75142df6d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:53.646998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a577a-1b03-41a3-99c1-7a75142df6d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:53.648934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a577a-1b03-41a3-99c1-7a75142df6d0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:53.742956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1215/2426] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:31:53 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:31:53.747227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37014e82-af2d-4076-9cea-614ad71e791d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:53.758901 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37014e82-af2d-4076-9cea-614ad71e791d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:53.817684 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21b957-817d-40f9-8caa-1b3a4a3f826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:53.818373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21b957-817d-40f9-8caa-1b3a4a3f826e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:53.818654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21b957-817d-40f9-8caa-1b3a4a3f826e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:53.818938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21b957-817d-40f9-8caa-1b3a4a3f826e admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:53.819626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21b957-817d-40f9-8caa-1b3a4a3f826e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:53.821584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21b957-817d-40f9-8caa-1b3a4a3f826e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:53.927385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1212/2427] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:31:53 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:31:53.931552 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a577a-1b03-41a3-99c1-7a75142df6d0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:53.942655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a577a-1b03-41a3-99c1-7a75142df6d0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:53.947327 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc95dac-b6d8-4dfa-bb99-ab0392b53a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:53.948028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc95dac-b6d8-4dfa-bb99-ab0392b53a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:53.948373 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc95dac-b6d8-4dfa-bb99-ab0392b53a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:53.948580 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc95dac-b6d8-4dfa-bb99-ab0392b53a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:53.949334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc95dac-b6d8-4dfa-bb99-ab0392b53a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:53.951181 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc95dac-b6d8-4dfa-bb99-ab0392b53a72 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:53.963118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1216/2428] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:31:53.967296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21b957-817d-40f9-8caa-1b3a4a3f826e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:53.977346 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21b957-817d-40f9-8caa-1b3a4a3f826e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:53.981888 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825f5e9-4cbf-4337-a46a-254ffe15921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:53.982812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825f5e9-4cbf-4337-a46a-254ffe15921e admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:53.983088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825f5e9-4cbf-4337-a46a-254ffe15921e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:53.983354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825f5e9-4cbf-4337-a46a-254ffe15921e admin admin] PATH_INFO: `/v3/projects/a1a322c5ca9243afb7c9f147268454c2/users/6cd71b462d80440d9ba0f66faae6c878/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:53.998173 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825f5e9-4cbf-4337-a46a-254ffe15921e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a322c5ca9243afb7c9f147268454c2, user_id=6cd71b462d80440d9ba0f66faae6c878, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:54.000787 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825f5e9-4cbf-4337-a46a-254ffe15921e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:54.070726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1213/2429] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:31:53 2022] PUT /identity/v3/projects/a1a322c5ca9243afb7c9f147268454c2/users/6cd71b462d80440d9ba0f66faae6c878/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:31:54.075018 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc95dac-b6d8-4dfa-bb99-ab0392b53a72 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:54.085725 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc95dac-b6d8-4dfa-bb99-ab0392b53a72 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:54.140518 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fd21a-3d31-4b76-adcd-235ab97f2188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:54.141214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fd21a-3d31-4b76-adcd-235ab97f2188 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:54.141500 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fd21a-3d31-4b76-adcd-235ab97f2188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:54.141803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fd21a-3d31-4b76-adcd-235ab97f2188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:54.142534 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fd21a-3d31-4b76-adcd-235ab97f2188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:54.144131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fd21a-3d31-4b76-adcd-235ab97f2188 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:54.155617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1217/2430] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:31:54.159480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825f5e9-4cbf-4337-a46a-254ffe15921e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:54.169822 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825f5e9-4cbf-4337-a46a-254ffe15921e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:54.174497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92580295-0e4a-4f75-92aa-be6195433292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:54.175454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92580295-0e4a-4f75-92aa-be6195433292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:54.175728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92580295-0e4a-4f75-92aa-be6195433292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:54.176007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92580295-0e4a-4f75-92aa-be6195433292 admin admin] PATH_INFO: `/v3/projects/a1a322c5ca9243afb7c9f147268454c2/users/6cd71b462d80440d9ba0f66faae6c878/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:54.178119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92580295-0e4a-4f75-92aa-be6195433292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a322c5ca9243afb7c9f147268454c2, user_id=6cd71b462d80440d9ba0f66faae6c878, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:54.180730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92580295-0e4a-4f75-92aa-be6195433292 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:54.191237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1214/2431] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:31:54 2022] PUT /identity/v3/projects/a1a322c5ca9243afb7c9f147268454c2/users/6cd71b462d80440d9ba0f66faae6c878/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:31:54.205100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ada54-d199-4401-96e3-9c4d35f3194b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:54.205546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ada54-d199-4401-96e3-9c4d35f3194b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:54.205854 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ada54-d199-4401-96e3-9c4d35f3194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:54.233195 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e68ada54-d199-4401-96e3-9c4d35f3194b None None] MFA Rules not processed for user `6cd71b462d80440d9ba0f66faae6c878`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:31:54.234393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e68ada54-d199-4401-96e3-9c4d35f3194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:54.305163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1218/2432] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:31:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:31:54.317420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92580295-0e4a-4f75-92aa-be6195433292 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:54.319281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-92580295-0e4a-4f75-92aa-be6195433292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:54.377713 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92580295-0e4a-4f75-92aa-be6195433292 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:54.382319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba601fa-d3d6-42e8-8ff5-2b7a9983af5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:54.383092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba601fa-d3d6-42e8-8ff5-2b7a9983af5e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:54.383378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba601fa-d3d6-42e8-8ff5-2b7a9983af5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:54.383656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba601fa-d3d6-42e8-8ff5-2b7a9983af5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:54.393828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba601fa-d3d6-42e8-8ff5-2b7a9983af5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:54.396294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba601fa-d3d6-42e8-8ff5-2b7a9983af5e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:54.409017 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1215/2433] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:31:54.671976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ada54-d199-4401-96e3-9c4d35f3194b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:31:54.676438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e68ada54-d199-4401-96e3-9c4d35f3194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:31:54.689696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ada54-d199-4401-96e3-9c4d35f3194b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:31:54.694000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb850768-2a1c-4919-aabb-67166c28360c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:31:54.694675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb850768-2a1c-4919-aabb-67166c28360c service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:31:54.694961 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb850768-2a1c-4919-aabb-67166c28360c service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:31:54.695239 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb850768-2a1c-4919-aabb-67166c28360c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:31:54.751419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb850768-2a1c-4919-aabb-67166c28360c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:31:54.752842 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb850768-2a1c-4919-aabb-67166c28360c service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:31:54.761544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1219/2434] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:01.899228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f87a53-b95b-4c68-b324-4fdb9ff6bf7e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:01.899750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f87a53-b95b-4c68-b324-4fdb9ff6bf7e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:01.899850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f87a53-b95b-4c68-b324-4fdb9ff6bf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:01.918404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f4f87a53-b95b-4c68-b324-4fdb9ff6bf7e None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:01.919530 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f4f87a53-b95b-4c68-b324-4fdb9ff6bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:01.974590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1216/2435] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:32:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:01.986585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb850768-2a1c-4919-aabb-67166c28360c service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:01.988080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fb850768-2a1c-4919-aabb-67166c28360c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:02.054014 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb850768-2a1c-4919-aabb-67166c28360c service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:02.058956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957597bd-2a2d-4e70-af9c-82586274f21d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:02.059598 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957597bd-2a2d-4e70-af9c-82586274f21d service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:02.059876 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957597bd-2a2d-4e70-af9c-82586274f21d service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:02.060147 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957597bd-2a2d-4e70-af9c-82586274f21d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:02.067941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957597bd-2a2d-4e70-af9c-82586274f21d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:02.069545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957597bd-2a2d-4e70-af9c-82586274f21d service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:02.077523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1220/2436] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:32:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:32:07.758129 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f87a53-b95b-4c68-b324-4fdb9ff6bf7e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:07.847038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f87a53-b95b-4c68-b324-4fdb9ff6bf7e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:07.852286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:07.853538 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:07.854068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:07.854450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] PATH_INFO: `/v3/users/0397dbba0a6c42849d021d87e090f7fc` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:07.861390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0397dbba0a6c42849d021d87e090f7fc)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:07.864099 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:08.080946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0397dbba0a6c42849d021d87e090f7fc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:08.093858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0397dbba0a6c42849d021d87e090f7fc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:08.162057 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0397dbba0a6c42849d021d87e090f7fc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:08.176480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0397dbba0a6c42849d021d87e090f7fc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:08.177423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0397dbba0a6c42849d021d87e090f7fc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:08.184296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1217/2437] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:07 2022] DELETE /identity/v3/users/0397dbba0a6c42849d021d87e090f7fc => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:08.189376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c00dde-8c2e-4d7c-bddb-acac88a1cc25 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:08.189940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c00dde-8c2e-4d7c-bddb-acac88a1cc25 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:08.190131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c00dde-8c2e-4d7c-bddb-acac88a1cc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:08.211110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-54c00dde-8c2e-4d7c-bddb-acac88a1cc25 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:08.212764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-54c00dde-8c2e-4d7c-bddb-acac88a1cc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:08.291526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1221/2438] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:08.297508 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:08.298950 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:08.361137 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d116a-2133-4c5d-a211-b5e8ace9ef21 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:08.366758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d32fe-1368-4d36-b409-cf767b8a2811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:08.367425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d32fe-1368-4d36-b409-cf767b8a2811 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:08.367704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d32fe-1368-4d36-b409-cf767b8a2811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:08.367982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d32fe-1368-4d36-b409-cf767b8a2811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:08.378028 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d32fe-1368-4d36-b409-cf767b8a2811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:08.388365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d32fe-1368-4d36-b409-cf767b8a2811 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:08.390743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1218/2439] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:08.854970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c00dde-8c2e-4d7c-bddb-acac88a1cc25 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:08.856523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-54c00dde-8c2e-4d7c-bddb-acac88a1cc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:08.871713 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c00dde-8c2e-4d7c-bddb-acac88a1cc25 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:08.878569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:08.881706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:08.882038 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:08.882579 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] PATH_INFO: `/v3/projects/d637e894357c485cb847dcc0b5fd8955` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:08.884414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d637e894357c485cb847dcc0b5fd8955)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:08.886750 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:09.055514 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd637e894357c485cb847dcc0b5fd8955', 'request_id': 'req-2fbbe682-059c-4921-bf02-e6405f3cd6fc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:09.176284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd637e894357c485cb847dcc0b5fd8955', 'request_id': 'req-2fbbe682-059c-4921-bf02-e6405f3cd6fc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:09.183166 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd637e894357c485cb847dcc0b5fd8955', 'request_id': 'req-2fbbe682-059c-4921-bf02-e6405f3cd6fc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:09.195067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] The token cache is being invalidate because project d637e894357c485cb847dcc0b5fd8955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:09.212272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:09.212272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:09.212272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1222/2440] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:08 2022] DELETE /identity/v3/projects/d637e894357c485cb847dcc0b5fd8955 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:09.212622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d32fe-1368-4d36-b409-cf767b8a2811 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:09.212622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d32fe-1368-4d36-b409-cf767b8a2811 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:09.272985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720f82f-1527-4e8d-8390-282b37305fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:09.273894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720f82f-1527-4e8d-8390-282b37305fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:09.274181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720f82f-1527-4e8d-8390-282b37305fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:09.274459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720f82f-1527-4e8d-8390-282b37305fe3 admin admin] PATH_INFO: `/v3/users/6cd71b462d80440d9ba0f66faae6c878` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:09.275665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720f82f-1527-4e8d-8390-282b37305fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd71b462d80440d9ba0f66faae6c878)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:09.277640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720f82f-1527-4e8d-8390-282b37305fe3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:09.490115 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1720f82f-1527-4e8d-8390-282b37305fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd71b462d80440d9ba0f66faae6c878'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:09.502927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1720f82f-1527-4e8d-8390-282b37305fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd71b462d80440d9ba0f66faae6c878'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:09.589725 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1720f82f-1527-4e8d-8390-282b37305fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd71b462d80440d9ba0f66faae6c878'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:09.599027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1720f82f-1527-4e8d-8390-282b37305fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd71b462d80440d9ba0f66faae6c878'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:09.599741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1720f82f-1527-4e8d-8390-282b37305fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd71b462d80440d9ba0f66faae6c878'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:09.614736 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1219/2441] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:09 2022] DELETE /identity/v3/users/6cd71b462d80440d9ba0f66faae6c878 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:10.143378 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:10.146134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:10.158130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbe682-059c-4921-bf02-e6405f3cd6fc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:10.218212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:10.219077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:10.219360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:10.219635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] PATH_INFO: `/v3/projects/a1a322c5ca9243afb7c9f147268454c2` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:10.220810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a322c5ca9243afb7c9f147268454c2)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:10.222823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:10.333281 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a322c5ca9243afb7c9f147268454c2', 'request_id': 'req-a2938f8c-c76c-440c-948b-603123212c59'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:10.423773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a322c5ca9243afb7c9f147268454c2', 'request_id': 'req-a2938f8c-c76c-440c-948b-603123212c59'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:10.431838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a322c5ca9243afb7c9f147268454c2', 'request_id': 'req-a2938f8c-c76c-440c-948b-603123212c59'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:10.443215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] The token cache is being invalidate because project a1a322c5ca9243afb7c9f147268454c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:10.443506 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:10.444150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a2938f8c-c76c-440c-948b-603123212c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:10.445812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1223/2442] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:10 2022] DELETE /identity/v3/projects/a1a322c5ca9243afb7c9f147268454c2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:10.451147 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adef324-6c12-4940-9c2d-73dab98b1675 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:10.451671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adef324-6c12-4940-9c2d-73dab98b1675 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:10.451671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adef324-6c12-4940-9c2d-73dab98b1675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:10.471534 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0adef324-6c12-4940-9c2d-73dab98b1675 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:10.473801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0adef324-6c12-4940-9c2d-73dab98b1675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:10.532166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1220/2443] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:10.540605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b816-e7b7-4be2-9e77-0ec5428bd709 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:10.540885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b816-e7b7-4be2-9e77-0ec5428bd709 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:10.541205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b816-e7b7-4be2-9e77-0ec5428bd709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:10.560214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bbb4b816-e7b7-4be2-9e77-0ec5428bd709 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:10.561456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bbb4b816-e7b7-4be2-9e77-0ec5428bd709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:10.569599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1224/2444] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:10.574034 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adef324-6c12-4940-9c2d-73dab98b1675 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:10.584247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adef324-6c12-4940-9c2d-73dab98b1675 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:10.588829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39c348-04a8-47a8-af05-c1d7fee6b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:10.589524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39c348-04a8-47a8-af05-c1d7fee6b417 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:10.589810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39c348-04a8-47a8-af05-c1d7fee6b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:10.590089 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39c348-04a8-47a8-af05-c1d7fee6b417 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:10.590815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39c348-04a8-47a8-af05-c1d7fee6b417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:32:10.591123 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39c348-04a8-47a8-af05-c1d7fee6b417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:10.592758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39c348-04a8-47a8-af05-c1d7fee6b417 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:10.605323 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1221/2445] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:32:10.609780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4b816-e7b7-4be2-9e77-0ec5428bd709 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:10.619841 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4b816-e7b7-4be2-9e77-0ec5428bd709 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:10.624644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e9666-430e-413b-9629-db94af4dfa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:10.625363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e9666-430e-413b-9629-db94af4dfa75 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:10.625648 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e9666-430e-413b-9629-db94af4dfa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:10.625925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e9666-430e-413b-9629-db94af4dfa75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:10.626643 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e9666-430e-413b-9629-db94af4dfa75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:10.628759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e9666-430e-413b-9629-db94af4dfa75 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:10.711182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1225/2446] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:10 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:10.715631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39c348-04a8-47a8-af05-c1d7fee6b417 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:10.726765 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39c348-04a8-47a8-af05-c1d7fee6b417 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:10.782482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee7344-fafa-45fa-8f86-7a70d9a0213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:10.783149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee7344-fafa-45fa-8f86-7a70d9a0213f admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:10.783428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee7344-fafa-45fa-8f86-7a70d9a0213f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:10.783700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee7344-fafa-45fa-8f86-7a70d9a0213f admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:10.784376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee7344-fafa-45fa-8f86-7a70d9a0213f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:10.786831 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee7344-fafa-45fa-8f86-7a70d9a0213f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:10.861477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1222/2447] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:10 2022] POST /identity/v3/users => generated 284 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:10.866481 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e9666-430e-413b-9629-db94af4dfa75 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:10.876883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e9666-430e-413b-9629-db94af4dfa75 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:10.882388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f83e5-5706-49d5-a76a-2ff2a22cf8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:10.883046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f83e5-5706-49d5-a76a-2ff2a22cf8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:10.883330 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f83e5-5706-49d5-a76a-2ff2a22cf8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:10.883605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f83e5-5706-49d5-a76a-2ff2a22cf8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:10.884350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f83e5-5706-49d5-a76a-2ff2a22cf8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:10.885972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f83e5-5706-49d5-a76a-2ff2a22cf8a7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:10.897148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1226/2448] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:10.901027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee7344-fafa-45fa-8f86-7a70d9a0213f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:10.910871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee7344-fafa-45fa-8f86-7a70d9a0213f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:10.915856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a849ac-f331-4abf-8ae2-7713e16102e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:10.916523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a849ac-f331-4abf-8ae2-7713e16102e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:10.916805 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a849ac-f331-4abf-8ae2-7713e16102e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:10.917110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a849ac-f331-4abf-8ae2-7713e16102e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:10.917832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a849ac-f331-4abf-8ae2-7713e16102e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:10.919407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a849ac-f331-4abf-8ae2-7713e16102e9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:10.930256 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1223/2449] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:10.934385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f83e5-5706-49d5-a76a-2ff2a22cf8a7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:10.945127 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f83e5-5706-49d5-a76a-2ff2a22cf8a7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:10.949644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbe869-a0b5-41ab-85d7-4150223755e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:10.950775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe869-a0b5-41ab-85d7-4150223755e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:10.951055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe869-a0b5-41ab-85d7-4150223755e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:10.951331 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe869-a0b5-41ab-85d7-4150223755e8 admin admin] PATH_INFO: `/v3/projects/5ec2b7cb223240eb81d2ac9e78314763/users/13cbd87a481a45d1837ba23bb14bb223/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:10.965826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbe869-a0b5-41ab-85d7-4150223755e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec2b7cb223240eb81d2ac9e78314763, user_id=13cbd87a481a45d1837ba23bb14bb223, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:10.968689 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbe869-a0b5-41ab-85d7-4150223755e8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:11.089941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1227/2450] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:10 2022] PUT /identity/v3/projects/5ec2b7cb223240eb81d2ac9e78314763/users/13cbd87a481a45d1837ba23bb14bb223/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:11.101839 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ea47-b3dd-4b11-a2ee-a1e119df1d5f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:11.102129 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ea47-b3dd-4b11-a2ee-a1e119df1d5f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:11.102407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ea47-b3dd-4b11-a2ee-a1e119df1d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:11.131039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-58f6ea47-b3dd-4b11-a2ee-a1e119df1d5f None None] MFA Rules not processed for user `13cbd87a481a45d1837ba23bb14bb223`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:11.132312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-58f6ea47-b3dd-4b11-a2ee-a1e119df1d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:11.196907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1224/2451] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:11.201882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbe869-a0b5-41ab-85d7-4150223755e8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:11.288710 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbe869-a0b5-41ab-85d7-4150223755e8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:11.294320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abbfd2-ad50-40a1-a5da-4595ea7b0e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:11.295007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abbfd2-ad50-40a1-a5da-4595ea7b0e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:11.295293 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abbfd2-ad50-40a1-a5da-4595ea7b0e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:11.295569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abbfd2-ad50-40a1-a5da-4595ea7b0e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:11.296267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abbfd2-ad50-40a1-a5da-4595ea7b0e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:11.298269 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abbfd2-ad50-40a1-a5da-4595ea7b0e50 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:11.406081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1228/2452] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:11 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:11.410007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6ea47-b3dd-4b11-a2ee-a1e119df1d5f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:11.420852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6ea47-b3dd-4b11-a2ee-a1e119df1d5f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:11.476023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657870e7-f9e9-437b-9bc6-51eca4ca9f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:11.476687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657870e7-f9e9-437b-9bc6-51eca4ca9f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:11.476889 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657870e7-f9e9-437b-9bc6-51eca4ca9f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:11.477210 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657870e7-f9e9-437b-9bc6-51eca4ca9f6e admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:11.477912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657870e7-f9e9-437b-9bc6-51eca4ca9f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:11.479843 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657870e7-f9e9-437b-9bc6-51eca4ca9f6e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:11.595455 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1225/2453] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:11 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:11.599730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abbfd2-ad50-40a1-a5da-4595ea7b0e50 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:11.609881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abbfd2-ad50-40a1-a5da-4595ea7b0e50 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:11.615271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63028-0dda-4cc1-a2e9-bc2ab60be208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:11.616083 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63028-0dda-4cc1-a2e9-bc2ab60be208 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:11.616369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63028-0dda-4cc1-a2e9-bc2ab60be208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:11.616649 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63028-0dda-4cc1-a2e9-bc2ab60be208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:11.617455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d63028-0dda-4cc1-a2e9-bc2ab60be208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:11.619103 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d63028-0dda-4cc1-a2e9-bc2ab60be208 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:11.631385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1229/2454] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:11.635731 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657870e7-f9e9-437b-9bc6-51eca4ca9f6e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:11.646850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657870e7-f9e9-437b-9bc6-51eca4ca9f6e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:11.651361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feec63-c06f-449c-ab4b-7b6ebd4e8f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:11.652376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feec63-c06f-449c-ab4b-7b6ebd4e8f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:11.652663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feec63-c06f-449c-ab4b-7b6ebd4e8f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:11.652949 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feec63-c06f-449c-ab4b-7b6ebd4e8f0e admin admin] PATH_INFO: `/v3/projects/46c11f91dfed48a1b7c639df692ca748/users/e4c9714adf9d46df99a10516a61122b6/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:11.670703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feec63-c06f-449c-ab4b-7b6ebd4e8f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c11f91dfed48a1b7c639df692ca748, user_id=e4c9714adf9d46df99a10516a61122b6, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:11.673407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feec63-c06f-449c-ab4b-7b6ebd4e8f0e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:11.764894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1226/2455] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:11 2022] PUT /identity/v3/projects/46c11f91dfed48a1b7c639df692ca748/users/e4c9714adf9d46df99a10516a61122b6/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:11.768763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63028-0dda-4cc1-a2e9-bc2ab60be208 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:11.779268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63028-0dda-4cc1-a2e9-bc2ab60be208 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:11.839212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0924-4ef1-4a42-920a-85091191caba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:11.844751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0924-4ef1-4a42-920a-85091191caba admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:11.844751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0924-4ef1-4a42-920a-85091191caba admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:11.844751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0924-4ef1-4a42-920a-85091191caba admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:11.844751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f0924-4ef1-4a42-920a-85091191caba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:11.844751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f0924-4ef1-4a42-920a-85091191caba admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:11.853961 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1230/2456] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:11.858204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feec63-c06f-449c-ab4b-7b6ebd4e8f0e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:11.869986 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feec63-c06f-449c-ab4b-7b6ebd4e8f0e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:11.874649 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c04f8-7dcb-4fdb-9b59-b52d4ef9d01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:11.875529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c04f8-7dcb-4fdb-9b59-b52d4ef9d01d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:11.879022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c04f8-7dcb-4fdb-9b59-b52d4ef9d01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:11.879022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c04f8-7dcb-4fdb-9b59-b52d4ef9d01d admin admin] PATH_INFO: `/v3/projects/46c11f91dfed48a1b7c639df692ca748/users/e4c9714adf9d46df99a10516a61122b6/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:11.879022 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c04f8-7dcb-4fdb-9b59-b52d4ef9d01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c11f91dfed48a1b7c639df692ca748, user_id=e4c9714adf9d46df99a10516a61122b6, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:11.880798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c04f8-7dcb-4fdb-9b59-b52d4ef9d01d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:11.891457 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1227/2457] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:11 2022] PUT /identity/v3/projects/46c11f91dfed48a1b7c639df692ca748/users/e4c9714adf9d46df99a10516a61122b6/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:11.902805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbd833-672a-4adc-99d8-0202293381e6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:11.903098 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbd833-672a-4adc-99d8-0202293381e6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:11.903384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbd833-672a-4adc-99d8-0202293381e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:11.932898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ebfbd833-672a-4adc-99d8-0202293381e6 None None] MFA Rules not processed for user `e4c9714adf9d46df99a10516a61122b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:11.934201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ebfbd833-672a-4adc-99d8-0202293381e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:12.008836 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1231/2458] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:12.021003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c04f8-7dcb-4fdb-9b59-b52d4ef9d01d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:12.022691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f44c04f8-7dcb-4fdb-9b59-b52d4ef9d01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:12.079433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c04f8-7dcb-4fdb-9b59-b52d4ef9d01d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:12.083644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49030c-ccf7-47e8-9fb1-e20dacf49526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:12.084292 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49030c-ccf7-47e8-9fb1-e20dacf49526 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:12.084571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49030c-ccf7-47e8-9fb1-e20dacf49526 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:12.084842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49030c-ccf7-47e8-9fb1-e20dacf49526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:12.094086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49030c-ccf7-47e8-9fb1-e20dacf49526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:12.095506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49030c-ccf7-47e8-9fb1-e20dacf49526 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:12.105596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1228/2459] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:15.286691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbd833-672a-4adc-99d8-0202293381e6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:15.348364 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbd833-672a-4adc-99d8-0202293381e6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:15.352942 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:15.353844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:15.354122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:15.354392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] PATH_INFO: `/v3/users/13cbd87a481a45d1837ba23bb14bb223` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:15.355598 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cbd87a481a45d1837ba23bb14bb223)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:15.357560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:15.600514 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cbd87a481a45d1837ba23bb14bb223'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:15.611849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cbd87a481a45d1837ba23bb14bb223'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:15.612583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cbd87a481a45d1837ba23bb14bb223'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:15.620304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cbd87a481a45d1837ba23bb14bb223'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:15.620949 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cbd87a481a45d1837ba23bb14bb223'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:15.752775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1232/2460] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:15 2022] DELETE /identity/v3/users/13cbd87a481a45d1837ba23bb14bb223 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:15.757848 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2e69e-4403-4445-968a-c6963bcfa668 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:15.758353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2e69e-4403-4445-968a-c6963bcfa668 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:15.758458 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2e69e-4403-4445-968a-c6963bcfa668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:15.776091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8ba2e69e-4403-4445-968a-c6963bcfa668 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:15.777351 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8ba2e69e-4403-4445-968a-c6963bcfa668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:15.835219 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1229/2461] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:15.844773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:15.846363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:15.903075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b77934-7ab4-4990-b285-95a752ccda37 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:15.906579 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ed4cf-fc83-4227-b7c4-0d8b44f4f985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:15.907205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ed4cf-fc83-4227-b7c4-0d8b44f4f985 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:15.907486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ed4cf-fc83-4227-b7c4-0d8b44f4f985 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:15.907761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ed4cf-fc83-4227-b7c4-0d8b44f4f985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:15.917823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ed4cf-fc83-4227-b7c4-0d8b44f4f985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:15.919275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ed4cf-fc83-4227-b7c4-0d8b44f4f985 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:15.929692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1233/2462] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:16.493596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2e69e-4403-4445-968a-c6963bcfa668 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:16.493596 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8ba2e69e-4403-4445-968a-c6963bcfa668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:16.507013 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2e69e-4403-4445-968a-c6963bcfa668 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:16.511691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:16.512556 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:16.512837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:16.513143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] PATH_INFO: `/v3/projects/5ec2b7cb223240eb81d2ac9e78314763` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:16.514315 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec2b7cb223240eb81d2ac9e78314763)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:16.516493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:16.631185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec2b7cb223240eb81d2ac9e78314763', 'request_id': 'req-ea0f4f32-ab4c-4570-a129-d279009527b4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:16.746708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec2b7cb223240eb81d2ac9e78314763', 'request_id': 'req-ea0f4f32-ab4c-4570-a129-d279009527b4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:16.755823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec2b7cb223240eb81d2ac9e78314763', 'request_id': 'req-ea0f4f32-ab4c-4570-a129-d279009527b4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:16.768888 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] The token cache is being invalidate because project 5ec2b7cb223240eb81d2ac9e78314763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:16.770152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:16.770758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:16.772810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1230/2463] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:16 2022] DELETE /identity/v3/projects/5ec2b7cb223240eb81d2ac9e78314763 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:16.776991 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ed4cf-fc83-4227-b7c4-0d8b44f4f985 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:16.787169 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ed4cf-fc83-4227-b7c4-0d8b44f4f985 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:16.843639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0490-997e-46d9-a18b-9da3d315aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:16.845091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0490-997e-46d9-a18b-9da3d315aef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:16.845384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0490-997e-46d9-a18b-9da3d315aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:16.845668 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0490-997e-46d9-a18b-9da3d315aef1 admin admin] PATH_INFO: `/v3/users/e4c9714adf9d46df99a10516a61122b6` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:16.847215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b0490-997e-46d9-a18b-9da3d315aef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c9714adf9d46df99a10516a61122b6)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:16.850728 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b0490-997e-46d9-a18b-9da3d315aef1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:17.037680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-808b0490-997e-46d9-a18b-9da3d315aef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c9714adf9d46df99a10516a61122b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:17.049332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-808b0490-997e-46d9-a18b-9da3d315aef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c9714adf9d46df99a10516a61122b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:17.050053 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-808b0490-997e-46d9-a18b-9da3d315aef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c9714adf9d46df99a10516a61122b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:17.057907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-808b0490-997e-46d9-a18b-9da3d315aef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c9714adf9d46df99a10516a61122b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:17.058531 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-808b0490-997e-46d9-a18b-9da3d315aef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c9714adf9d46df99a10516a61122b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:17.126523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1234/2464] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:16 2022] DELETE /identity/v3/users/e4c9714adf9d46df99a10516a61122b6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:17.557488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:17.560540 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:17.572682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f4f32-ab4c-4570-a129-d279009527b4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:17.630737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:17.631602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:17.631880 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:17.632153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] PATH_INFO: `/v3/projects/46c11f91dfed48a1b7c639df692ca748` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:17.633483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c11f91dfed48a1b7c639df692ca748)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:17.635330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:17.743810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c11f91dfed48a1b7c639df692ca748', 'request_id': 'req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:17.841357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c11f91dfed48a1b7c639df692ca748', 'request_id': 'req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:17.848733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c11f91dfed48a1b7c639df692ca748', 'request_id': 'req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:17.859745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] The token cache is being invalidate because project 46c11f91dfed48a1b7c639df692ca748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:17.860032 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:17.860679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-be80c1f3-75ea-4635-8cb6-82b4dbd6d2bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:17.862229 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1231/2465] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:17 2022] DELETE /identity/v3/projects/46c11f91dfed48a1b7c639df692ca748 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:17.867779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a664e-d08f-4808-acf0-557986c3ac79 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:17.868266 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a664e-d08f-4808-acf0-557986c3ac79 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:17.868385 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a664e-d08f-4808-acf0-557986c3ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:17.886116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2d7a664e-d08f-4808-acf0-557986c3ac79 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:17.887307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2d7a664e-d08f-4808-acf0-557986c3ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:17.944659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1235/2466] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:17.952783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fae781-6f24-41c1-9252-0e37297c75a6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:17.953104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fae781-6f24-41c1-9252-0e37297c75a6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:17.953386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fae781-6f24-41c1-9252-0e37297c75a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:17.973140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-13fae781-6f24-41c1-9252-0e37297c75a6 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:17.974371 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-13fae781-6f24-41c1-9252-0e37297c75a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:17.982515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1232/2467] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:17.986736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a664e-d08f-4808-acf0-557986c3ac79 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:17.996654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a664e-d08f-4808-acf0-557986c3ac79 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:18.001297 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6301-691b-4905-9e97-662d6ec01fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:18.001972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6301-691b-4905-9e97-662d6ec01fae admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:18.002250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6301-691b-4905-9e97-662d6ec01fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:18.002520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6301-691b-4905-9e97-662d6ec01fae admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:18.003236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6301-691b-4905-9e97-662d6ec01fae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:32:18.004056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6301-691b-4905-9e97-662d6ec01fae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:18.005718 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6301-691b-4905-9e97-662d6ec01fae admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:18.017078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1236/2468] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:32:18.022258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fae781-6f24-41c1-9252-0e37297c75a6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:18.031522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fae781-6f24-41c1-9252-0e37297c75a6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:18.036183 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c781e-f30e-44f5-a169-ecb09c413ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:18.036831 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c781e-f30e-44f5-a169-ecb09c413ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:18.037145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c781e-f30e-44f5-a169-ecb09c413ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:18.037419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c781e-f30e-44f5-a169-ecb09c413ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:18.038112 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c781e-f30e-44f5-a169-ecb09c413ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:18.040003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c781e-f30e-44f5-a169-ecb09c413ac9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:18.112525 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1233/2469] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:18 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:18.114433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6301-691b-4905-9e97-662d6ec01fae admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:18.129593 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6301-691b-4905-9e97-662d6ec01fae admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:18.130318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c4b6-954e-4208-bb79-fe3e9f10aded None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:18.130547 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c4b6-954e-4208-bb79-fe3e9f10aded None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:18.131048 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c4b6-954e-4208-bb79-fe3e9f10aded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:18.207402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a2a36-a02e-451f-9226-c108621e24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:18.208400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2a36-a02e-451f-9226-c108621e24c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:18.208688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2a36-a02e-451f-9226-c108621e24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:18.208984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2a36-a02e-451f-9226-c108621e24c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:18.209743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a2a36-a02e-451f-9226-c108621e24c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:18.211711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a2a36-a02e-451f-9226-c108621e24c8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:18.284000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5974c4b6-954e-4208-bb79-fe3e9f10aded None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:18.285301 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5974c4b6-954e-4208-bb79-fe3e9f10aded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:18.287889 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1237/2470] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:18 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:32:18.291703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a2a36-a02e-451f-9226-c108621e24c8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:18.302008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a2a36-a02e-451f-9226-c108621e24c8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:18.307118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23668a02-906b-45e4-afc6-628a4e56cf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:18.307792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23668a02-906b-45e4-afc6-628a4e56cf29 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:18.308080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23668a02-906b-45e4-afc6-628a4e56cf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:18.308357 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23668a02-906b-45e4-afc6-628a4e56cf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:18.309126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23668a02-906b-45e4-afc6-628a4e56cf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:18.310744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23668a02-906b-45e4-afc6-628a4e56cf29 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:18.322202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1238/2471] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:32:18.326535 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23668a02-906b-45e4-afc6-628a4e56cf29 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:18.338175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23668a02-906b-45e4-afc6-628a4e56cf29 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:18.343456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d0520-ccd6-4e7b-93c4-98e2557f3cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:18.344203 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d0520-ccd6-4e7b-93c4-98e2557f3cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:18.344438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d0520-ccd6-4e7b-93c4-98e2557f3cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:18.344691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d0520-ccd6-4e7b-93c4-98e2557f3cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:18.345441 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d0520-ccd6-4e7b-93c4-98e2557f3cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:18.345885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1234/2472] 10.222.0.61 () {58 vars in 967 bytes} [Tue Apr 12 14:32:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:18.348207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d0520-ccd6-4e7b-93c4-98e2557f3cd1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:18.359601 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974c4b6-954e-4208-bb79-fe3e9f10aded None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:18.361117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5974c4b6-954e-4208-bb79-fe3e9f10aded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:18.365075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1239/2473] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:32:18.368263 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d0520-ccd6-4e7b-93c4-98e2557f3cd1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:18.384675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d0520-ccd6-4e7b-93c4-98e2557f3cd1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:18.390785 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812632f-22ce-43ec-8d92-50fca0972cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:18.391709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812632f-22ce-43ec-8d92-50fca0972cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:18.392004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812632f-22ce-43ec-8d92-50fca0972cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:18.392211 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812632f-22ce-43ec-8d92-50fca0972cfe admin admin] PATH_INFO: `/v3/projects/fe4e24a680ab429bbe36e372497f5862/users/b0248b438ad845bf9a9493e82ecd6650/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:18.409446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812632f-22ce-43ec-8d92-50fca0972cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4e24a680ab429bbe36e372497f5862, user_id=b0248b438ad845bf9a9493e82ecd6650, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:18.414360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812632f-22ce-43ec-8d92-50fca0972cfe admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:18.447199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974c4b6-954e-4208-bb79-fe3e9f10aded None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:18.452769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921fbc9-6548-4a5f-abf0-9a8d35a7e477 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:18.453524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921fbc9-6548-4a5f-abf0-9a8d35a7e477 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:18.453812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921fbc9-6548-4a5f-abf0-9a8d35a7e477 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:18.454085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921fbc9-6548-4a5f-abf0-9a8d35a7e477 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:18.462505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921fbc9-6548-4a5f-abf0-9a8d35a7e477 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:18.464926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921fbc9-6548-4a5f-abf0-9a8d35a7e477 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:18.476220 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1235/2474] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:32:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 14:32:18.536884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1240/2475] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:18 2022] PUT /identity/v3/projects/fe4e24a680ab429bbe36e372497f5862/users/b0248b438ad845bf9a9493e82ecd6650/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:32:18.548789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f50d6d-8cae-44a1-95cc-d24b7671574e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:18.549104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f50d6d-8cae-44a1-95cc-d24b7671574e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:18.549379 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f50d6d-8cae-44a1-95cc-d24b7671574e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:18.577300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b3f50d6d-8cae-44a1-95cc-d24b7671574e None None] MFA Rules not processed for user `b0248b438ad845bf9a9493e82ecd6650`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:18.578496 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b3f50d6d-8cae-44a1-95cc-d24b7671574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:18.642197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1236/2476] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:18.646499 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812632f-22ce-43ec-8d92-50fca0972cfe admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:18.708416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812632f-22ce-43ec-8d92-50fca0972cfe admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:18.713190 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3c99-71d1-48e3-b91c-a2e41f53bb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:18.713841 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3c99-71d1-48e3-b91c-a2e41f53bb3f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:18.714117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3c99-71d1-48e3-b91c-a2e41f53bb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:18.714389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3c99-71d1-48e3-b91c-a2e41f53bb3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:18.715069 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a3c99-71d1-48e3-b91c-a2e41f53bb3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:18.717567 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a3c99-71d1-48e3-b91c-a2e41f53bb3f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:18.837173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1241/2477] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:18 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:18.841407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f50d6d-8cae-44a1-95cc-d24b7671574e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:18.853008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f50d6d-8cae-44a1-95cc-d24b7671574e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:18.910602 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57163c61-8d55-43e8-83be-4ed6294eddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:18.911598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57163c61-8d55-43e8-83be-4ed6294eddad admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:18.911878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57163c61-8d55-43e8-83be-4ed6294eddad admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:18.912171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57163c61-8d55-43e8-83be-4ed6294eddad admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:18.912987 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57163c61-8d55-43e8-83be-4ed6294eddad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:18.914837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57163c61-8d55-43e8-83be-4ed6294eddad admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:19.059668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1237/2478] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:18 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:19.063549 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3c99-71d1-48e3-b91c-a2e41f53bb3f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:19.074662 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3c99-71d1-48e3-b91c-a2e41f53bb3f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:19.079706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c085ed-6e52-4733-ab9c-d65ef9616517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:19.080368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c085ed-6e52-4733-ab9c-d65ef9616517 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:19.080653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c085ed-6e52-4733-ab9c-d65ef9616517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:19.080927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c085ed-6e52-4733-ab9c-d65ef9616517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:19.082257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c085ed-6e52-4733-ab9c-d65ef9616517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:19.083999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c085ed-6e52-4733-ab9c-d65ef9616517 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:19.095029 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1242/2479] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:19.100299 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57163c61-8d55-43e8-83be-4ed6294eddad admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:19.110464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57163c61-8d55-43e8-83be-4ed6294eddad admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:19.115224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9f345-5371-47f5-af90-c58568c26890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:19.116108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f345-5371-47f5-af90-c58568c26890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:19.116390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f345-5371-47f5-af90-c58568c26890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:19.116663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f345-5371-47f5-af90-c58568c26890 admin admin] PATH_INFO: `/v3/projects/cafde060b8a74a9bb5b4bdfb78a12a5e/users/73289d19700744e1855c5988d05442a4/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:19.131288 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9f345-5371-47f5-af90-c58568c26890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafde060b8a74a9bb5b4bdfb78a12a5e, user_id=73289d19700744e1855c5988d05442a4, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:19.134107 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9f345-5371-47f5-af90-c58568c26890 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:19.255509 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1238/2480] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:19 2022] PUT /identity/v3/projects/cafde060b8a74a9bb5b4bdfb78a12a5e/users/73289d19700744e1855c5988d05442a4/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:19.259341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c085ed-6e52-4733-ab9c-d65ef9616517 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:19.270952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c085ed-6e52-4733-ab9c-d65ef9616517 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:19.360768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8392ed4-8658-4cf5-8c95-898f2ca067d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:19.361595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392ed4-8658-4cf5-8c95-898f2ca067d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:19.361980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392ed4-8658-4cf5-8c95-898f2ca067d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:19.362705 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392ed4-8658-4cf5-8c95-898f2ca067d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:19.363921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8392ed4-8658-4cf5-8c95-898f2ca067d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:19.366382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8392ed4-8658-4cf5-8c95-898f2ca067d0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:19.377668 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1243/2481] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:19.382360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9f345-5371-47f5-af90-c58568c26890 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:19.393248 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9f345-5371-47f5-af90-c58568c26890 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:19.398908 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051c74-abab-4d10-9ccd-ad3a1cab6c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:19.399779 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051c74-abab-4d10-9ccd-ad3a1cab6c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:19.400056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051c74-abab-4d10-9ccd-ad3a1cab6c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:19.400322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051c74-abab-4d10-9ccd-ad3a1cab6c18 admin admin] PATH_INFO: `/v3/projects/cafde060b8a74a9bb5b4bdfb78a12a5e/users/73289d19700744e1855c5988d05442a4/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:19.402272 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35051c74-abab-4d10-9ccd-ad3a1cab6c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafde060b8a74a9bb5b4bdfb78a12a5e, user_id=73289d19700744e1855c5988d05442a4, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:19.404846 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35051c74-abab-4d10-9ccd-ad3a1cab6c18 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:19.416148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1239/2482] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:19 2022] PUT /identity/v3/projects/cafde060b8a74a9bb5b4bdfb78a12a5e/users/73289d19700744e1855c5988d05442a4/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:19.426787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365a94a-d8c3-4768-9a17-e1eea1ccc592 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:19.427061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365a94a-d8c3-4768-9a17-e1eea1ccc592 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:19.427342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365a94a-d8c3-4768-9a17-e1eea1ccc592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:19.455231 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b365a94a-d8c3-4768-9a17-e1eea1ccc592 None None] MFA Rules not processed for user `73289d19700744e1855c5988d05442a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:19.457186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b365a94a-d8c3-4768-9a17-e1eea1ccc592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:19.530208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1244/2483] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:19.542162 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051c74-abab-4d10-9ccd-ad3a1cab6c18 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:19.543840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-35051c74-abab-4d10-9ccd-ad3a1cab6c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:19.606698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051c74-abab-4d10-9ccd-ad3a1cab6c18 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:19.611000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07caafe0-9db2-45e6-89ca-2123bb4538f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:19.611768 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caafe0-9db2-45e6-89ca-2123bb4538f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:19.612054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caafe0-9db2-45e6-89ca-2123bb4538f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:19.612325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caafe0-9db2-45e6-89ca-2123bb4538f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:19.624003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07caafe0-9db2-45e6-89ca-2123bb4538f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:19.625450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07caafe0-9db2-45e6-89ca-2123bb4538f1 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:19.639130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1240/2484] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:19.719090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365a94a-d8c3-4768-9a17-e1eea1ccc592 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:19.785306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365a94a-d8c3-4768-9a17-e1eea1ccc592 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:19.790062 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:19.790925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:19.791315 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:19.791799 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] PATH_INFO: `/v3/users/b0248b438ad845bf9a9493e82ecd6650` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:19.793304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0248b438ad845bf9a9493e82ecd6650)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:19.795257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:20.084671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0248b438ad845bf9a9493e82ecd6650'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:20.096457 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0248b438ad845bf9a9493e82ecd6650'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:20.097803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0248b438ad845bf9a9493e82ecd6650'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:20.104920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0248b438ad845bf9a9493e82ecd6650'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:20.105627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0248b438ad845bf9a9493e82ecd6650'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:20.179181 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1245/2485] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:19 2022] DELETE /identity/v3/users/b0248b438ad845bf9a9493e82ecd6650 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:20.185163 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b4981-1904-491a-b7e7-438308df1bf8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:20.185693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b4981-1904-491a-b7e7-438308df1bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:20.185693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b4981-1904-491a-b7e7-438308df1bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:20.204319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-642b4981-1904-491a-b7e7-438308df1bf8 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:20.205590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-642b4981-1904-491a-b7e7-438308df1bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:20.271890 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1241/2486] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:20.283043 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:20.283824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:20.344685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e681e0-0752-41b0-8f38-2b03e121c6bd admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:20.351717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d530cf9-6eac-40fa-a554-b48dd32816a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:20.352828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d530cf9-6eac-40fa-a554-b48dd32816a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:20.353320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d530cf9-6eac-40fa-a554-b48dd32816a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:20.353781 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d530cf9-6eac-40fa-a554-b48dd32816a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:20.367028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d530cf9-6eac-40fa-a554-b48dd32816a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:20.368350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d530cf9-6eac-40fa-a554-b48dd32816a7 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:20.381748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1246/2487] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:20.882138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b4981-1904-491a-b7e7-438308df1bf8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:20.883656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-642b4981-1904-491a-b7e7-438308df1bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:20.897154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b4981-1904-491a-b7e7-438308df1bf8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:20.902738 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:20.904164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:20.904419 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:20.904699 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] PATH_INFO: `/v3/projects/fe4e24a680ab429bbe36e372497f5862` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:20.907711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4e24a680ab429bbe36e372497f5862)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:20.911034 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:21.060050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4e24a680ab429bbe36e372497f5862', 'request_id': 'req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:21.130343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4e24a680ab429bbe36e372497f5862', 'request_id': 'req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:21.137136 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4e24a680ab429bbe36e372497f5862', 'request_id': 'req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:21.148752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] The token cache is being invalidate because project fe4e24a680ab429bbe36e372497f5862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:21.149932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:21.149932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:21.151247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1242/2488] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:20 2022] DELETE /identity/v3/projects/fe4e24a680ab429bbe36e372497f5862 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:21.155374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d530cf9-6eac-40fa-a554-b48dd32816a7 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:21.165089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d530cf9-6eac-40fa-a554-b48dd32816a7 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:21.219260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a96ba-71e0-4fe2-833e-b664fbc0e82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:21.220125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a96ba-71e0-4fe2-833e-b664fbc0e82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:21.220403 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a96ba-71e0-4fe2-833e-b664fbc0e82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:21.220674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a96ba-71e0-4fe2-833e-b664fbc0e82e admin admin] PATH_INFO: `/v3/users/73289d19700744e1855c5988d05442a4` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:21.221879 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a96ba-71e0-4fe2-833e-b664fbc0e82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73289d19700744e1855c5988d05442a4)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:21.224116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a96ba-71e0-4fe2-833e-b664fbc0e82e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:21.403427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-647a96ba-71e0-4fe2-833e-b664fbc0e82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73289d19700744e1855c5988d05442a4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:21.416151 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-647a96ba-71e0-4fe2-833e-b664fbc0e82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73289d19700744e1855c5988d05442a4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:21.416858 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-647a96ba-71e0-4fe2-833e-b664fbc0e82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73289d19700744e1855c5988d05442a4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:21.423604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-647a96ba-71e0-4fe2-833e-b664fbc0e82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73289d19700744e1855c5988d05442a4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:21.429307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-647a96ba-71e0-4fe2-833e-b664fbc0e82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73289d19700744e1855c5988d05442a4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:21.529443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1247/2489] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:21 2022] DELETE /identity/v3/users/73289d19700744e1855c5988d05442a4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:22.120525 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:22.122537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:22.136025 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18da2b2-e7f7-4ee1-be5b-2abff3b1bdd5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:22.194080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:22.194933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:22.195212 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:22.195482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] PATH_INFO: `/v3/projects/cafde060b8a74a9bb5b4bdfb78a12a5e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:22.196672 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] RBAC: Authorizing `identity:delete_project(project_id=cafde060b8a74a9bb5b4bdfb78a12a5e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:22.198609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:22.363836 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafde060b8a74a9bb5b4bdfb78a12a5e', 'request_id': 'req-39190979-240c-40c1-b65d-b77496bd94af'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:22.483727 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafde060b8a74a9bb5b4bdfb78a12a5e', 'request_id': 'req-39190979-240c-40c1-b65d-b77496bd94af'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:22.491180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafde060b8a74a9bb5b4bdfb78a12a5e', 'request_id': 'req-39190979-240c-40c1-b65d-b77496bd94af'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:22.501731 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] The token cache is being invalidate because project cafde060b8a74a9bb5b4bdfb78a12a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:22.502031 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:22.502655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39190979-240c-40c1-b65d-b77496bd94af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:22.504390 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1243/2490] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:22 2022] DELETE /identity/v3/projects/cafde060b8a74a9bb5b4bdfb78a12a5e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:22.509478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2151-1a38-4b38-8f70-8d5f2242f3e9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:22.509947 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2151-1a38-4b38-8f70-8d5f2242f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:22.510073 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2151-1a38-4b38-8f70-8d5f2242f3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:22.529229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-497e2151-1a38-4b38-8f70-8d5f2242f3e9 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:22.530424 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-497e2151-1a38-4b38-8f70-8d5f2242f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:22.589192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1248/2491] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:22.597541 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ae4e6-987f-4402-a9db-c9d706a77fad None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:22.597825 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ae4e6-987f-4402-a9db-c9d706a77fad None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:22.598111 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ae4e6-987f-4402-a9db-c9d706a77fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:22.616923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e50ae4e6-987f-4402-a9db-c9d706a77fad None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:22.618072 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e50ae4e6-987f-4402-a9db-c9d706a77fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:22.625782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1244/2492] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:22.630102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2151-1a38-4b38-8f70-8d5f2242f3e9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:22.639768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2151-1a38-4b38-8f70-8d5f2242f3e9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:22.644446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e519-72c5-43b8-8739-28070882e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:22.645136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e519-72c5-43b8-8739-28070882e314 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:22.645423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e519-72c5-43b8-8739-28070882e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:22.645698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e519-72c5-43b8-8739-28070882e314 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:22.646426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e519-72c5-43b8-8739-28070882e314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:32:22.646739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e519-72c5-43b8-8739-28070882e314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:22.648377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e519-72c5-43b8-8739-28070882e314 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:22.660701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1249/2493] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:32:22.665209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ae4e6-987f-4402-a9db-c9d706a77fad None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:22.674539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ae4e6-987f-4402-a9db-c9d706a77fad None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:22.680078 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ac86d-5aa8-420c-a579-993dadb718b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:22.680732 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac86d-5aa8-420c-a579-993dadb718b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:22.681038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac86d-5aa8-420c-a579-993dadb718b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:22.681312 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac86d-5aa8-420c-a579-993dadb718b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:22.681990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ac86d-5aa8-420c-a579-993dadb718b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:22.683864 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ac86d-5aa8-420c-a579-993dadb718b0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:22.773963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1245/2494] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:22 2022] POST /identity/v3/projects => generated 399 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:22.778118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e519-72c5-43b8-8739-28070882e314 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:22.789221 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e519-72c5-43b8-8739-28070882e314 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:22.846850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae916f-1b3f-44fe-9d5b-3fbc581fe627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:22.848147 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae916f-1b3f-44fe-9d5b-3fbc581fe627 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:22.848499 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae916f-1b3f-44fe-9d5b-3fbc581fe627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:22.848775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae916f-1b3f-44fe-9d5b-3fbc581fe627 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:22.849509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae916f-1b3f-44fe-9d5b-3fbc581fe627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:22.851490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae916f-1b3f-44fe-9d5b-3fbc581fe627 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:22.979245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1250/2495] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:22 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:22.984795 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ac86d-5aa8-420c-a579-993dadb718b0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:22.995351 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ac86d-5aa8-420c-a579-993dadb718b0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:22.999891 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4267958-6bec-4851-84f4-ada13b631ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:23.000551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4267958-6bec-4851-84f4-ada13b631ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:23.000835 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4267958-6bec-4851-84f4-ada13b631ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:23.001150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4267958-6bec-4851-84f4-ada13b631ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:23.001876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4267958-6bec-4851-84f4-ada13b631ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:23.003483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4267958-6bec-4851-84f4-ada13b631ac6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:23.014196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1246/2496] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:23.018247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae916f-1b3f-44fe-9d5b-3fbc581fe627 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:23.029776 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae916f-1b3f-44fe-9d5b-3fbc581fe627 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:23.035350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b1010-ddfd-445e-8804-2863f9ab3120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:23.036029 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b1010-ddfd-445e-8804-2863f9ab3120 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:23.036334 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b1010-ddfd-445e-8804-2863f9ab3120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:23.036610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b1010-ddfd-445e-8804-2863f9ab3120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:23.037394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b1010-ddfd-445e-8804-2863f9ab3120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:23.038961 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b1010-ddfd-445e-8804-2863f9ab3120 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:23.049125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1251/2497] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:23.053394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4267958-6bec-4851-84f4-ada13b631ac6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:23.063099 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4267958-6bec-4851-84f4-ada13b631ac6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:23.068058 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c3141-40d9-404e-9f1f-573363e56273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:23.069005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c3141-40d9-404e-9f1f-573363e56273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:23.069302 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c3141-40d9-404e-9f1f-573363e56273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:23.069575 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c3141-40d9-404e-9f1f-573363e56273 admin admin] PATH_INFO: `/v3/projects/eb1623b228ce4c6fb26d9f840521d537/users/2bbd8ed42d9c456295c938637a9a1e8a/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:23.085443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c3141-40d9-404e-9f1f-573363e56273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1623b228ce4c6fb26d9f840521d537, user_id=2bbd8ed42d9c456295c938637a9a1e8a, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:23.088147 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c3141-40d9-404e-9f1f-573363e56273 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:23.175247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1247/2498] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:23 2022] PUT /identity/v3/projects/eb1623b228ce4c6fb26d9f840521d537/users/2bbd8ed42d9c456295c938637a9a1e8a/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:23.185763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92a2af-ed4f-42ee-9477-a5ebce9b0611 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:23.186838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92a2af-ed4f-42ee-9477-a5ebce9b0611 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:23.186838 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92a2af-ed4f-42ee-9477-a5ebce9b0611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:23.214238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1d92a2af-ed4f-42ee-9477-a5ebce9b0611 None None] MFA Rules not processed for user `2bbd8ed42d9c456295c938637a9a1e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:23.215469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1d92a2af-ed4f-42ee-9477-a5ebce9b0611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:23.277788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1252/2499] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:23.282382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c3141-40d9-404e-9f1f-573363e56273 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:23.344695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c3141-40d9-404e-9f1f-573363e56273 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:23.349708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8d945-9b84-4a4e-b305-4a9b1d4b09e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:23.350365 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d945-9b84-4a4e-b305-4a9b1d4b09e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:23.350642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d945-9b84-4a4e-b305-4a9b1d4b09e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:23.350912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d945-9b84-4a4e-b305-4a9b1d4b09e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:23.351608 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8d945-9b84-4a4e-b305-4a9b1d4b09e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:23.353505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8d945-9b84-4a4e-b305-4a9b1d4b09e8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:23.460231 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1248/2500] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:23 2022] POST /identity/v3/projects => generated 401 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:23.464415 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92a2af-ed4f-42ee-9477-a5ebce9b0611 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:23.475478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92a2af-ed4f-42ee-9477-a5ebce9b0611 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:23.532291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917396df-c6b0-4752-90a3-7cefa78063fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:23.532955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917396df-c6b0-4752-90a3-7cefa78063fa admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:23.533191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917396df-c6b0-4752-90a3-7cefa78063fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:23.533491 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917396df-c6b0-4752-90a3-7cefa78063fa admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:23.534225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917396df-c6b0-4752-90a3-7cefa78063fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:23.536237 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917396df-c6b0-4752-90a3-7cefa78063fa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:23.670555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1253/2501] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:23 2022] POST /identity/v3/users => generated 307 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:23.674769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8d945-9b84-4a4e-b305-4a9b1d4b09e8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:23.685826 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8d945-9b84-4a4e-b305-4a9b1d4b09e8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:23.690341 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384a2ce-ee24-4ca1-baad-d3179829b721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:23.691581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384a2ce-ee24-4ca1-baad-d3179829b721 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:23.692010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384a2ce-ee24-4ca1-baad-d3179829b721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:23.692217 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384a2ce-ee24-4ca1-baad-d3179829b721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:23.692939 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384a2ce-ee24-4ca1-baad-d3179829b721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:23.694604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384a2ce-ee24-4ca1-baad-d3179829b721 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:23.705357 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1249/2502] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:23.709636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917396df-c6b0-4752-90a3-7cefa78063fa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:23.719890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917396df-c6b0-4752-90a3-7cefa78063fa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:23.725652 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa6cdc-4919-4911-b604-44ba256ff7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:23.726527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa6cdc-4919-4911-b604-44ba256ff7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:23.726803 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa6cdc-4919-4911-b604-44ba256ff7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:23.727072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa6cdc-4919-4911-b604-44ba256ff7d6 admin admin] PATH_INFO: `/v3/projects/8ae6679d791b46c5a176997ff419331e/users/ca66978dceef468f83d02c4cd649306f/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:23.742808 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa6cdc-4919-4911-b604-44ba256ff7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae6679d791b46c5a176997ff419331e, user_id=ca66978dceef468f83d02c4cd649306f, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:23.745484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa6cdc-4919-4911-b604-44ba256ff7d6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:23.822471 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1254/2503] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:23 2022] PUT /identity/v3/projects/8ae6679d791b46c5a176997ff419331e/users/ca66978dceef468f83d02c4cd649306f/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:23.826719 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384a2ce-ee24-4ca1-baad-d3179829b721 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:23.837443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384a2ce-ee24-4ca1-baad-d3179829b721 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:23.892711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb59103-357e-44dd-a405-b5a75d4adf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:23.893424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb59103-357e-44dd-a405-b5a75d4adf1d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:23.893728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb59103-357e-44dd-a405-b5a75d4adf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:23.894100 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb59103-357e-44dd-a405-b5a75d4adf1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:23.894842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb59103-357e-44dd-a405-b5a75d4adf1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:23.896447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb59103-357e-44dd-a405-b5a75d4adf1d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:23.906315 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1250/2504] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:23.910558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa6cdc-4919-4911-b604-44ba256ff7d6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:23.921192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa6cdc-4919-4911-b604-44ba256ff7d6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:23.926395 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b81ff-b1c0-4ef2-833d-ff0787b77471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:23.927279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b81ff-b1c0-4ef2-833d-ff0787b77471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:23.927562 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b81ff-b1c0-4ef2-833d-ff0787b77471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:23.927840 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b81ff-b1c0-4ef2-833d-ff0787b77471 admin admin] PATH_INFO: `/v3/projects/8ae6679d791b46c5a176997ff419331e/users/ca66978dceef468f83d02c4cd649306f/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:23.929836 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b81ff-b1c0-4ef2-833d-ff0787b77471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae6679d791b46c5a176997ff419331e, user_id=ca66978dceef468f83d02c4cd649306f, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:23.932455 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b81ff-b1c0-4ef2-833d-ff0787b77471 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:23.943401 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1255/2505] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:23 2022] PUT /identity/v3/projects/8ae6679d791b46c5a176997ff419331e/users/ca66978dceef468f83d02c4cd649306f/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:23.954121 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eefe21-63b1-4bab-8818-64616849c22b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:23.954420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eefe21-63b1-4bab-8818-64616849c22b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:23.954704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eefe21-63b1-4bab-8818-64616849c22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:23.980348 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-75eefe21-63b1-4bab-8818-64616849c22b None None] MFA Rules not processed for user `ca66978dceef468f83d02c4cd649306f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:23.981696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-75eefe21-63b1-4bab-8818-64616849c22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:24.048633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1251/2506] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:24.060492 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b81ff-b1c0-4ef2-833d-ff0787b77471 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:24.062206 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f98b81ff-b1c0-4ef2-833d-ff0787b77471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:24.117873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b81ff-b1c0-4ef2-833d-ff0787b77471 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:24.121438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cb7cd-601a-4201-ba79-95c6ebf8d0bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:24.122075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb7cd-601a-4201-ba79-95c6ebf8d0bd service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:24.122357 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb7cd-601a-4201-ba79-95c6ebf8d0bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:24.122630 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb7cd-601a-4201-ba79-95c6ebf8d0bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:24.131578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cb7cd-601a-4201-ba79-95c6ebf8d0bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:24.133030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cb7cd-601a-4201-ba79-95c6ebf8d0bd service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:24.142412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1256/2507] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:24.363361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eefe21-63b1-4bab-8818-64616849c22b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:24.372900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eefe21-63b1-4bab-8818-64616849c22b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:24.376376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c5838-ff5e-4cb4-8cb4-fd45f4e13c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:24.377054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c5838-ff5e-4cb4-8cb4-fd45f4e13c7f service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:24.377336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c5838-ff5e-4cb4-8cb4-fd45f4e13c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:24.377613 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c5838-ff5e-4cb4-8cb4-fd45f4e13c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:24.431864 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c5838-ff5e-4cb4-8cb4-fd45f4e13c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:24.433318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c5838-ff5e-4cb4-8cb4-fd45f4e13c7f service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:24.442195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1252/2508] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:29.933446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cb7cd-601a-4201-ba79-95c6ebf8d0bd service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:29.995835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cb7cd-601a-4201-ba79-95c6ebf8d0bd service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:30.000413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:30.001303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:30.001584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:30.001853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] PATH_INFO: `/v3/users/2bbd8ed42d9c456295c938637a9a1e8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:30.003093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bbd8ed42d9c456295c938637a9a1e8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:30.005027 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:30.229020 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bbd8ed42d9c456295c938637a9a1e8a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:30.241386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bbd8ed42d9c456295c938637a9a1e8a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:30.242064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bbd8ed42d9c456295c938637a9a1e8a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:30.248583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bbd8ed42d9c456295c938637a9a1e8a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:30.249259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bbd8ed42d9c456295c938637a9a1e8a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:30.342276 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1257/2509] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:29 2022] DELETE /identity/v3/users/2bbd8ed42d9c456295c938637a9a1e8a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:32:30.347432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1e7ef-9c91-40de-a1a0-c5c9031d80ed None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:30.347899 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1e7ef-9c91-40de-a1a0-c5c9031d80ed None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:30.348038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1e7ef-9c91-40de-a1a0-c5c9031d80ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:30.365219 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-98e1e7ef-9c91-40de-a1a0-c5c9031d80ed None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:30.366523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-98e1e7ef-9c91-40de-a1a0-c5c9031d80ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:30.428246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1253/2510] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:30.441659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:30.441659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:30.497525 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1b938-23de-4282-a2dc-50b1bd12eb53 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:30.501098 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4f83e-a4f5-4f9a-afa7-657984a245a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:30.501819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f83e-a4f5-4f9a-afa7-657984a245a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:30.504672 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f83e-a4f5-4f9a-afa7-657984a245a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:30.504672 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f83e-a4f5-4f9a-afa7-657984a245a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:30.512015 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4f83e-a4f5-4f9a-afa7-657984a245a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:30.513585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4f83e-a4f5-4f9a-afa7-657984a245a7 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:30.524039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1258/2511] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:31.097051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1e7ef-9c91-40de-a1a0-c5c9031d80ed None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:31.098553 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-98e1e7ef-9c91-40de-a1a0-c5c9031d80ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:31.111109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1e7ef-9c91-40de-a1a0-c5c9031d80ed None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:31.116223 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:31.117129 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:31.117415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:31.117689 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] PATH_INFO: `/v3/projects/eb1623b228ce4c6fb26d9f840521d537` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:31.118918 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1623b228ce4c6fb26d9f840521d537)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:31.120892 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:31.258648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1623b228ce4c6fb26d9f840521d537', 'request_id': 'req-56a20907-d3eb-44c7-bf5e-ac22c5310dba'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:31.355433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1623b228ce4c6fb26d9f840521d537', 'request_id': 'req-56a20907-d3eb-44c7-bf5e-ac22c5310dba'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:31.362752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1623b228ce4c6fb26d9f840521d537', 'request_id': 'req-56a20907-d3eb-44c7-bf5e-ac22c5310dba'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:31.372842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] The token cache is being invalidate because project eb1623b228ce4c6fb26d9f840521d537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:31.373261 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:31.373970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:31.375513 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1254/2512] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:31 2022] DELETE /identity/v3/projects/eb1623b228ce4c6fb26d9f840521d537 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:31.380342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4f83e-a4f5-4f9a-afa7-657984a245a7 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:31.390172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4f83e-a4f5-4f9a-afa7-657984a245a7 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:31.445939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20c90-09fa-4a6c-8ef0-1a51df85e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:31.446797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20c90-09fa-4a6c-8ef0-1a51df85e02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:31.447078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20c90-09fa-4a6c-8ef0-1a51df85e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:31.447350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20c90-09fa-4a6c-8ef0-1a51df85e02c admin admin] PATH_INFO: `/v3/users/ca66978dceef468f83d02c4cd649306f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:31.448532 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab20c90-09fa-4a6c-8ef0-1a51df85e02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca66978dceef468f83d02c4cd649306f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:31.450732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab20c90-09fa-4a6c-8ef0-1a51df85e02c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:31.611402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bab20c90-09fa-4a6c-8ef0-1a51df85e02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca66978dceef468f83d02c4cd649306f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:31.623365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bab20c90-09fa-4a6c-8ef0-1a51df85e02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca66978dceef468f83d02c4cd649306f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:31.624030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bab20c90-09fa-4a6c-8ef0-1a51df85e02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca66978dceef468f83d02c4cd649306f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:31.631264 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bab20c90-09fa-4a6c-8ef0-1a51df85e02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca66978dceef468f83d02c4cd649306f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:31.631914 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bab20c90-09fa-4a6c-8ef0-1a51df85e02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca66978dceef468f83d02c4cd649306f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:31.715445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1259/2513] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:31 2022] DELETE /identity/v3/users/ca66978dceef468f83d02c4cd649306f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:32.140221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:32.141661 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:32.157973 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a20907-d3eb-44c7-bf5e-ac22c5310dba admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:32.214083 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:32.214979 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:32.215215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:32.215480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] PATH_INFO: `/v3/projects/8ae6679d791b46c5a176997ff419331e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:32.216648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae6679d791b46c5a176997ff419331e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:32.218555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:32.337485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae6679d791b46c5a176997ff419331e', 'request_id': 'req-04513aba-a7b9-4250-94c0-6f771676e0bb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:32.441184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae6679d791b46c5a176997ff419331e', 'request_id': 'req-04513aba-a7b9-4250-94c0-6f771676e0bb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:32.447799 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae6679d791b46c5a176997ff419331e', 'request_id': 'req-04513aba-a7b9-4250-94c0-6f771676e0bb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:32.458287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] The token cache is being invalidate because project 8ae6679d791b46c5a176997ff419331e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:32.458573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:32.459213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04513aba-a7b9-4250-94c0-6f771676e0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:32.460739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1255/2514] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:32 2022] DELETE /identity/v3/projects/8ae6679d791b46c5a176997ff419331e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:32.465787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33397578-c675-4c40-84e6-3f8c85e0ea7b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:32.466271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33397578-c675-4c40-84e6-3f8c85e0ea7b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:32.466366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33397578-c675-4c40-84e6-3f8c85e0ea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:32.485267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-33397578-c675-4c40-84e6-3f8c85e0ea7b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:32.486469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-33397578-c675-4c40-84e6-3f8c85e0ea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:32.545407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1260/2515] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:32.554951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3afde-2709-4aee-9bdb-0bab22ac5df0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:32.555265 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3afde-2709-4aee-9bdb-0bab22ac5df0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:32.555555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3afde-2709-4aee-9bdb-0bab22ac5df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:32.573743 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-96a3afde-2709-4aee-9bdb-0bab22ac5df0 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:32.574933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-96a3afde-2709-4aee-9bdb-0bab22ac5df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:32.583590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1256/2516] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:32.587827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33397578-c675-4c40-84e6-3f8c85e0ea7b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:32.599192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33397578-c675-4c40-84e6-3f8c85e0ea7b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:32.604233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826b2b3-7f0a-4ff7-beed-679c8710597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:32.604888 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b2b3-7f0a-4ff7-beed-679c8710597d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:32.605199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b2b3-7f0a-4ff7-beed-679c8710597d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:32.605488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b2b3-7f0a-4ff7-beed-679c8710597d admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:32.606228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b2b3-7f0a-4ff7-beed-679c8710597d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:32:32.606537 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b2b3-7f0a-4ff7-beed-679c8710597d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:32.608213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b2b3-7f0a-4ff7-beed-679c8710597d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:32.620000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1261/2517] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:32:32.624448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3afde-2709-4aee-9bdb-0bab22ac5df0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:32.633566 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3afde-2709-4aee-9bdb-0bab22ac5df0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:32.638145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f0099-bba5-418c-b656-300143d59753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:32.641791 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f0099-bba5-418c-b656-300143d59753 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:32.641791 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f0099-bba5-418c-b656-300143d59753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:32.641791 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f0099-bba5-418c-b656-300143d59753 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:32.641791 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f0099-bba5-418c-b656-300143d59753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:32.642118 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f0099-bba5-418c-b656-300143d59753 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:32.774667 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1257/2518] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:32 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:32.778794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826b2b3-7f0a-4ff7-beed-679c8710597d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:32.789785 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826b2b3-7f0a-4ff7-beed-679c8710597d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:32.844164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7ebff-2443-41c0-8121-338cc8410c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:32.844825 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7ebff-2443-41c0-8121-338cc8410c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:32.845138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7ebff-2443-41c0-8121-338cc8410c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:32.845420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7ebff-2443-41c0-8121-338cc8410c1b admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:32.846102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7ebff-2443-41c0-8121-338cc8410c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:32.848760 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7ebff-2443-41c0-8121-338cc8410c1b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:32.935358 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1262/2519] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:32 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:32.939519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f0099-bba5-418c-b656-300143d59753 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:32.950850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f0099-bba5-418c-b656-300143d59753 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:32.955540 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390876b3-4729-4985-a1d9-99652c6334fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:32.956914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390876b3-4729-4985-a1d9-99652c6334fa admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:32.957234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390876b3-4729-4985-a1d9-99652c6334fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:32.957504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390876b3-4729-4985-a1d9-99652c6334fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:32.958225 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390876b3-4729-4985-a1d9-99652c6334fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:32.959800 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390876b3-4729-4985-a1d9-99652c6334fa admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:32.970115 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1258/2520] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:32.974595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7ebff-2443-41c0-8121-338cc8410c1b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:32.984495 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7ebff-2443-41c0-8121-338cc8410c1b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:32.989303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3bb48-3964-41de-8f15-f775b1de0e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:32.989957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3bb48-3964-41de-8f15-f775b1de0e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:32.990236 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3bb48-3964-41de-8f15-f775b1de0e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:32.990507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3bb48-3964-41de-8f15-f775b1de0e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:32.991222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3bb48-3964-41de-8f15-f775b1de0e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:32.992817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3bb48-3964-41de-8f15-f775b1de0e07 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:33.002759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1263/2521] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:33.008078 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390876b3-4729-4985-a1d9-99652c6334fa admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:33.017890 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390876b3-4729-4985-a1d9-99652c6334fa admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:33.023514 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e3a9e-4b62-41db-b294-255b9bd541ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:33.024396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3a9e-4b62-41db-b294-255b9bd541ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:33.024730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3a9e-4b62-41db-b294-255b9bd541ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:33.024945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3a9e-4b62-41db-b294-255b9bd541ed admin admin] PATH_INFO: `/v3/projects/5ffc685791444112a283137f2e17a00f/users/ca5f6dc566764452b9f4c95bf55841a8/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:33.039985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e3a9e-4b62-41db-b294-255b9bd541ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffc685791444112a283137f2e17a00f, user_id=ca5f6dc566764452b9f4c95bf55841a8, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:33.042741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e3a9e-4b62-41db-b294-255b9bd541ed admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:33.104792 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1259/2522] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:33 2022] PUT /identity/v3/projects/5ffc685791444112a283137f2e17a00f/users/ca5f6dc566764452b9f4c95bf55841a8/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:32:33.118677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9454b-07a8-416d-8e1a-acdd730dc323 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:33.118970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9454b-07a8-416d-8e1a-acdd730dc323 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:33.119337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9454b-07a8-416d-8e1a-acdd730dc323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:33.129704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e3a9e-4b62-41db-b294-255b9bd541ed admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:33.131480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-104e3a9e-4b62-41db-b294-255b9bd541ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:33.147591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-45d9454b-07a8-416d-8e1a-acdd730dc323 None None] MFA Rules not processed for user `ca5f6dc566764452b9f4c95bf55841a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:33.148792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-45d9454b-07a8-416d-8e1a-acdd730dc323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:33.189091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e3a9e-4b62-41db-b294-255b9bd541ed admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:33.193522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ee900-cf2a-4c5c-8086-ad1c72e8e170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:33.194171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ee900-cf2a-4c5c-8086-ad1c72e8e170 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:33.194450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ee900-cf2a-4c5c-8086-ad1c72e8e170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:33.194783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ee900-cf2a-4c5c-8086-ad1c72e8e170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:33.196572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b01ee900-cf2a-4c5c-8086-ad1c72e8e170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:33.212119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1264/2523] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:33.216443 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9454b-07a8-416d-8e1a-acdd730dc323 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:33.261091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ee900-cf2a-4c5c-8086-ad1c72e8e170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:33.262640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ee900-cf2a-4c5c-8086-ad1c72e8e170 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:33.272876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1260/2524] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:33.280063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9454b-07a8-416d-8e1a-acdd730dc323 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:33.284646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032369a-ba13-4ece-8ee5-5d3576a02548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:33.285343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032369a-ba13-4ece-8ee5-5d3576a02548 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:33.285626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032369a-ba13-4ece-8ee5-5d3576a02548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:33.285902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032369a-ba13-4ece-8ee5-5d3576a02548 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:33.286585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032369a-ba13-4ece-8ee5-5d3576a02548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:33.288471 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032369a-ba13-4ece-8ee5-5d3576a02548 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:33.413030 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1265/2525] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:33 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:32:33.415369 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ee900-cf2a-4c5c-8086-ad1c72e8e170 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:33.425867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ee900-cf2a-4c5c-8086-ad1c72e8e170 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:33.481750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184cd41-331c-44ca-be48-9f53d6e0337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:33.482418 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184cd41-331c-44ca-be48-9f53d6e0337d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:33.482700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184cd41-331c-44ca-be48-9f53d6e0337d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:33.482976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184cd41-331c-44ca-be48-9f53d6e0337d admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:33.483664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184cd41-331c-44ca-be48-9f53d6e0337d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:33.485627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184cd41-331c-44ca-be48-9f53d6e0337d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:33.613712 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1261/2526] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:33 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:33.618058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032369a-ba13-4ece-8ee5-5d3576a02548 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:33.628956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032369a-ba13-4ece-8ee5-5d3576a02548 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:33.633861 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d79dc3-095d-4a6f-a4f7-64cd34d0b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:33.634523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d79dc3-095d-4a6f-a4f7-64cd34d0b10e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:33.634804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d79dc3-095d-4a6f-a4f7-64cd34d0b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:33.635076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d79dc3-095d-4a6f-a4f7-64cd34d0b10e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:33.635792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d79dc3-095d-4a6f-a4f7-64cd34d0b10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:33.637530 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d79dc3-095d-4a6f-a4f7-64cd34d0b10e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:33.648345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1266/2527] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:32:33.652928 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184cd41-331c-44ca-be48-9f53d6e0337d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:33.663352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184cd41-331c-44ca-be48-9f53d6e0337d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:33.669093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b718f87-cbf4-48a6-ac22-49627eda103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:33.670001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b718f87-cbf4-48a6-ac22-49627eda103f admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:33.670279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b718f87-cbf4-48a6-ac22-49627eda103f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:33.670554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b718f87-cbf4-48a6-ac22-49627eda103f admin admin] PATH_INFO: `/v3/projects/ee7a01cefbda4f7e9656379b00e4b634/users/9c64aaa6e1b04cb582f8b0d821424a57/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:33.686862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b718f87-cbf4-48a6-ac22-49627eda103f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7a01cefbda4f7e9656379b00e4b634, user_id=9c64aaa6e1b04cb582f8b0d821424a57, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:33.689607 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b718f87-cbf4-48a6-ac22-49627eda103f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:33.795598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1262/2528] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:33 2022] PUT /identity/v3/projects/ee7a01cefbda4f7e9656379b00e4b634/users/9c64aaa6e1b04cb582f8b0d821424a57/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:33.799637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d79dc3-095d-4a6f-a4f7-64cd34d0b10e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:33.810299 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d79dc3-095d-4a6f-a4f7-64cd34d0b10e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:33.865235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea9814-1b2c-4386-a951-39eb7112a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:33.865840 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9814-1b2c-4386-a951-39eb7112a45e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:33.866116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9814-1b2c-4386-a951-39eb7112a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:33.866387 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9814-1b2c-4386-a951-39eb7112a45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:33.867104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea9814-1b2c-4386-a951-39eb7112a45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:33.868707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea9814-1b2c-4386-a951-39eb7112a45e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:33.878874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1267/2529] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:33.883200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b718f87-cbf4-48a6-ac22-49627eda103f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:33.893729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b718f87-cbf4-48a6-ac22-49627eda103f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:33.898527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3c15f-e7d0-4b6d-bd8a-0b96e7ae9d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:33.899493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c15f-e7d0-4b6d-bd8a-0b96e7ae9d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:33.899852 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c15f-e7d0-4b6d-bd8a-0b96e7ae9d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:33.900197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c15f-e7d0-4b6d-bd8a-0b96e7ae9d6d admin admin] PATH_INFO: `/v3/projects/ee7a01cefbda4f7e9656379b00e4b634/users/9c64aaa6e1b04cb582f8b0d821424a57/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:33.902285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3c15f-e7d0-4b6d-bd8a-0b96e7ae9d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7a01cefbda4f7e9656379b00e4b634, user_id=9c64aaa6e1b04cb582f8b0d821424a57, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:33.904902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3c15f-e7d0-4b6d-bd8a-0b96e7ae9d6d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:33.915937 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1263/2530] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:33 2022] PUT /identity/v3/projects/ee7a01cefbda4f7e9656379b00e4b634/users/9c64aaa6e1b04cb582f8b0d821424a57/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:33.932761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318b57-96e0-4fac-864c-8cc81d178382 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:33.933079 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318b57-96e0-4fac-864c-8cc81d178382 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:33.933354 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318b57-96e0-4fac-864c-8cc81d178382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:33.961202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f5318b57-96e0-4fac-864c-8cc81d178382 None None] MFA Rules not processed for user `9c64aaa6e1b04cb582f8b0d821424a57`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:33.962491 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f5318b57-96e0-4fac-864c-8cc81d178382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:34.030064 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1268/2531] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:34.041556 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3c15f-e7d0-4b6d-bd8a-0b96e7ae9d6d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:34.043258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-89e3c15f-e7d0-4b6d-bd8a-0b96e7ae9d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:34.104045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3c15f-e7d0-4b6d-bd8a-0b96e7ae9d6d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:34.107867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec56c-abba-475d-86a3-3da64e246a38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:34.108519 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec56c-abba-475d-86a3-3da64e246a38 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:34.108802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec56c-abba-475d-86a3-3da64e246a38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:34.109111 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec56c-abba-475d-86a3-3da64e246a38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:34.118562 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fec56c-abba-475d-86a3-3da64e246a38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:34.119956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fec56c-abba-475d-86a3-3da64e246a38 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:34.129628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1264/2532] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:34.260209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5318b57-96e0-4fac-864c-8cc81d178382 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:34.322942 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5318b57-96e0-4fac-864c-8cc81d178382 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:34.327866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:34.328727 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:34.329029 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:34.329306 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] PATH_INFO: `/v3/users/ca5f6dc566764452b9f4c95bf55841a8` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:34.330482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5f6dc566764452b9f4c95bf55841a8)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:34.333032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:34.572067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5f6dc566764452b9f4c95bf55841a8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:34.584631 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5f6dc566764452b9f4c95bf55841a8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:34.585433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5f6dc566764452b9f4c95bf55841a8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:34.592148 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5f6dc566764452b9f4c95bf55841a8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:34.596660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5f6dc566764452b9f4c95bf55841a8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:34.713566 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1269/2533] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:34 2022] DELETE /identity/v3/users/ca5f6dc566764452b9f4c95bf55841a8 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:34.718604 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe02a2-8827-44b8-b908-7230500d00a2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:34.719129 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe02a2-8827-44b8-b908-7230500d00a2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:34.719337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe02a2-8827-44b8-b908-7230500d00a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:34.736792 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-76fe02a2-8827-44b8-b908-7230500d00a2 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:34.738306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-76fe02a2-8827-44b8-b908-7230500d00a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:34.801550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1265/2534] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:34.811400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:34.812825 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:34.873210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab433-dd5b-45b1-82b4-6e8a662bf580 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:34.876823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da79b-7b5f-43cb-ba68-dfff0f472e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:34.877509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da79b-7b5f-43cb-ba68-dfff0f472e5a service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:34.877806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da79b-7b5f-43cb-ba68-dfff0f472e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:34.878674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da79b-7b5f-43cb-ba68-dfff0f472e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:34.888125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842da79b-7b5f-43cb-ba68-dfff0f472e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:34.889601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842da79b-7b5f-43cb-ba68-dfff0f472e5a service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:34.899482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1270/2535] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:35.311932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe02a2-8827-44b8-b908-7230500d00a2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:35.313667 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-76fe02a2-8827-44b8-b908-7230500d00a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:35.328791 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe02a2-8827-44b8-b908-7230500d00a2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:35.334860 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:35.335964 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:35.336336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:35.336659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] PATH_INFO: `/v3/projects/5ffc685791444112a283137f2e17a00f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:35.338404 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffc685791444112a283137f2e17a00f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:35.340484 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:35.453565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffc685791444112a283137f2e17a00f', 'request_id': 'req-108b8d3a-3b9f-4ada-a037-04e0860d91e0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:35.550280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffc685791444112a283137f2e17a00f', 'request_id': 'req-108b8d3a-3b9f-4ada-a037-04e0860d91e0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:35.559309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffc685791444112a283137f2e17a00f', 'request_id': 'req-108b8d3a-3b9f-4ada-a037-04e0860d91e0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:35.573456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] The token cache is being invalidate because project 5ffc685791444112a283137f2e17a00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:35.573854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:35.574583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:35.579590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1266/2536] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:35 2022] DELETE /identity/v3/projects/5ffc685791444112a283137f2e17a00f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:35.581724 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da79b-7b5f-43cb-ba68-dfff0f472e5a service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:35.592903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da79b-7b5f-43cb-ba68-dfff0f472e5a service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:35.658508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c082f6d-ddc2-4ecb-aad5-cabb197e1d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:35.659722 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082f6d-ddc2-4ecb-aad5-cabb197e1d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:35.660076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082f6d-ddc2-4ecb-aad5-cabb197e1d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:35.660429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082f6d-ddc2-4ecb-aad5-cabb197e1d0e admin admin] PATH_INFO: `/v3/users/9c64aaa6e1b04cb582f8b0d821424a57` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:35.661775 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c082f6d-ddc2-4ecb-aad5-cabb197e1d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c64aaa6e1b04cb582f8b0d821424a57)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:35.663815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c082f6d-ddc2-4ecb-aad5-cabb197e1d0e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:35.973268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0c082f6d-ddc2-4ecb-aad5-cabb197e1d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c64aaa6e1b04cb582f8b0d821424a57'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:35.985113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0c082f6d-ddc2-4ecb-aad5-cabb197e1d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c64aaa6e1b04cb582f8b0d821424a57'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:35.985824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0c082f6d-ddc2-4ecb-aad5-cabb197e1d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c64aaa6e1b04cb582f8b0d821424a57'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:35.993412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0c082f6d-ddc2-4ecb-aad5-cabb197e1d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c64aaa6e1b04cb582f8b0d821424a57'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:35.994096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0c082f6d-ddc2-4ecb-aad5-cabb197e1d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c64aaa6e1b04cb582f8b0d821424a57'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:36.080034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1271/2537] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:35 2022] DELETE /identity/v3/users/9c64aaa6e1b04cb582f8b0d821424a57 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:36.597819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:36.602731 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:36.620906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b8d3a-3b9f-4ada-a037-04e0860d91e0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:36.690129 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:36.692010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:36.692360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:36.692701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] PATH_INFO: `/v3/projects/ee7a01cefbda4f7e9656379b00e4b634` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:36.694076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7a01cefbda4f7e9656379b00e4b634)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:36.696223 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:36.829447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7a01cefbda4f7e9656379b00e4b634', 'request_id': 'req-123c316f-17d9-42f2-8d13-d3e20ed3edc9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:36.897910 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7a01cefbda4f7e9656379b00e4b634', 'request_id': 'req-123c316f-17d9-42f2-8d13-d3e20ed3edc9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:36.905232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7a01cefbda4f7e9656379b00e4b634', 'request_id': 'req-123c316f-17d9-42f2-8d13-d3e20ed3edc9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:36.917611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] The token cache is being invalidate because project ee7a01cefbda4f7e9656379b00e4b634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:36.917919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:36.918577 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-123c316f-17d9-42f2-8d13-d3e20ed3edc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:36.920262 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1267/2538] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:36 2022] DELETE /identity/v3/projects/ee7a01cefbda4f7e9656379b00e4b634 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:36.926646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad1f0-2f2c-4381-9209-302142679324 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:36.927128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad1f0-2f2c-4381-9209-302142679324 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:36.927583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad1f0-2f2c-4381-9209-302142679324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:36.948232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-47bad1f0-2f2c-4381-9209-302142679324 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:36.949824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-47bad1f0-2f2c-4381-9209-302142679324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:37.014081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1272/2539] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:37.023143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813774a-699c-4378-b0ba-ce0dc8046bb0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:37.023464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813774a-699c-4378-b0ba-ce0dc8046bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:37.023746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813774a-699c-4378-b0ba-ce0dc8046bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:37.044708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5813774a-699c-4378-b0ba-ce0dc8046bb0 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:37.045972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5813774a-699c-4378-b0ba-ce0dc8046bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:37.054654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1268/2540] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:37.059318 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bad1f0-2f2c-4381-9209-302142679324 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:37.071359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bad1f0-2f2c-4381-9209-302142679324 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:37.076929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1bbb1-8b08-4504-97c3-633a36e1ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:37.077873 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1bbb1-8b08-4504-97c3-633a36e1ae71 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:37.078280 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1bbb1-8b08-4504-97c3-633a36e1ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:37.078652 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1bbb1-8b08-4504-97c3-633a36e1ae71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:37.079489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1bbb1-8b08-4504-97c3-633a36e1ae71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:32:37.079893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1bbb1-8b08-4504-97c3-633a36e1ae71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:37.082504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1bbb1-8b08-4504-97c3-633a36e1ae71 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:37.096282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1273/2541] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:32:37.102116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813774a-699c-4378-b0ba-ce0dc8046bb0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:37.111554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813774a-699c-4378-b0ba-ce0dc8046bb0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:37.118482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe863a8e-34bd-4110-b52e-b77bf345a331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:37.119259 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe863a8e-34bd-4110-b52e-b77bf345a331 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:37.119606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe863a8e-34bd-4110-b52e-b77bf345a331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:37.119944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe863a8e-34bd-4110-b52e-b77bf345a331 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:37.120700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe863a8e-34bd-4110-b52e-b77bf345a331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:37.122705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe863a8e-34bd-4110-b52e-b77bf345a331 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:37.230443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1269/2542] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:37 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:37.232387 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1bbb1-8b08-4504-97c3-633a36e1ae71 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:37.244782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1bbb1-8b08-4504-97c3-633a36e1ae71 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:37.306642 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071e6f0-9696-42ff-b651-f12e7b0ae2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:37.307303 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071e6f0-9696-42ff-b651-f12e7b0ae2be admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:37.307584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071e6f0-9696-42ff-b651-f12e7b0ae2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:37.307854 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071e6f0-9696-42ff-b651-f12e7b0ae2be admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:37.308544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071e6f0-9696-42ff-b651-f12e7b0ae2be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:37.310475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071e6f0-9696-42ff-b651-f12e7b0ae2be admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:37.547690 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe863a8e-34bd-4110-b52e-b77bf345a331 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:37.548391 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fe863a8e-34bd-4110-b52e-b77bf345a331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:37.562957 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe863a8e-34bd-4110-b52e-b77bf345a331 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:37.567515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:37.568384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:37.568692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:37.568991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] PATH_INFO: `/v3/users/764047899a7f46569e12e14dda41b30d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:37.570202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] RBAC: Authorizing `identity:delete_user(user_id=764047899a7f46569e12e14dda41b30d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:37.572100 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:37.604612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1274/2543] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:37 2022] POST /identity/v3/users => generated 288 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:37.609189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071e6f0-9696-42ff-b651-f12e7b0ae2be admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:37.619990 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071e6f0-9696-42ff-b651-f12e7b0ae2be admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:37.624847 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323db12-0fe9-4ace-934f-42607fa22b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:37.625541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323db12-0fe9-4ace-934f-42607fa22b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:37.625827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323db12-0fe9-4ace-934f-42607fa22b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:37.626105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323db12-0fe9-4ace-934f-42607fa22b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:37.626834 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323db12-0fe9-4ace-934f-42607fa22b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:37.628602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323db12-0fe9-4ace-934f-42607fa22b04 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:37.638690 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1275/2544] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:32:37.642592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323db12-0fe9-4ace-934f-42607fa22b04 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:37.652722 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323db12-0fe9-4ace-934f-42607fa22b04 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:37.657425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b89084-b72b-414d-a7a0-ed75c51dda6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:37.658109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b89084-b72b-414d-a7a0-ed75c51dda6c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:37.658398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b89084-b72b-414d-a7a0-ed75c51dda6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:37.658677 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b89084-b72b-414d-a7a0-ed75c51dda6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:37.659947 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b89084-b72b-414d-a7a0-ed75c51dda6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:37.665453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b89084-b72b-414d-a7a0-ed75c51dda6c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:37.672839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1276/2545] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:32:37.677682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b89084-b72b-414d-a7a0-ed75c51dda6c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:37.687463 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b89084-b72b-414d-a7a0-ed75c51dda6c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:37.692559 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b18f5b-62c6-4480-908e-6671c261cbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:37.693474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b18f5b-62c6-4480-908e-6671c261cbf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:37.693755 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b18f5b-62c6-4480-908e-6671c261cbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:37.694160 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b18f5b-62c6-4480-908e-6671c261cbf9 admin admin] PATH_INFO: `/v3/projects/d0311ca0e4784db68b15543d7930ef01/users/996b3ddd20744e19b9fffee0aba52903/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:37.709911 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b18f5b-62c6-4480-908e-6671c261cbf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0311ca0e4784db68b15543d7930ef01, user_id=996b3ddd20744e19b9fffee0aba52903, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:37.712599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b18f5b-62c6-4480-908e-6671c261cbf9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:37.836340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1277/2546] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:37 2022] PUT /identity/v3/projects/d0311ca0e4784db68b15543d7930ef01/users/996b3ddd20744e19b9fffee0aba52903/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:32:37.847381 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3c0d-e5e1-4a7c-8432-8c5485503cb0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:37.847791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3c0d-e5e1-4a7c-8432-8c5485503cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:37.848085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3c0d-e5e1-4a7c-8432-8c5485503cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:37.848241 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764047899a7f46569e12e14dda41b30d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:37.860164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764047899a7f46569e12e14dda41b30d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:37.874055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ee4f3c0d-e5e1-4a7c-8432-8c5485503cb0 None None] MFA Rules not processed for user `996b3ddd20744e19b9fffee0aba52903`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:37.875265 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ee4f3c0d-e5e1-4a7c-8432-8c5485503cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:37.937153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1278/2547] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:37.948209 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f3c0d-e5e1-4a7c-8432-8c5485503cb0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:37.949607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ee4f3c0d-e5e1-4a7c-8432-8c5485503cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:37.958196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764047899a7f46569e12e14dda41b30d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:37.965874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764047899a7f46569e12e14dda41b30d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:37.972244 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764047899a7f46569e12e14dda41b30d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:37.973469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1270/2548] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:37 2022] DELETE /identity/v3/users/764047899a7f46569e12e14dda41b30d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:32:38.011522 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f3c0d-e5e1-4a7c-8432-8c5485503cb0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:38.060884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3efdb-e703-48ee-84be-8611c082a9b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef8bbd229c488d97f167c810bc7cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:38.061624 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3efdb-e703-48ee-84be-8611c082a9b8 service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:38.061835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3efdb-e703-48ee-84be-8611c082a9b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:38.062105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3efdb-e703-48ee-84be-8611c082a9b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:38.063903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e9b3efdb-e703-48ee-84be-8611c082a9b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:38.129289 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3efdb-e703-48ee-84be-8611c082a9b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:38.130792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3efdb-e703-48ee-84be-8611c082a9b8 service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:38.140001 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1279/2549] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:32:38.215385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:38.217865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:38.285064 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a904c69-d060-4bb3-a761-bb2cd490416d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:38.289847 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:38.290786 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:38.291038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:38.291309 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] PATH_INFO: `/v3/projects/e143bfbb72ff477eb0314ce2e307742b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:38.292627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e143bfbb72ff477eb0314ce2e307742b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:38.294539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:38.400160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e143bfbb72ff477eb0314ce2e307742b', 'request_id': 'req-49a5af2f-97e9-4d91-99cc-bc5deb787c89'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:38.529699 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e143bfbb72ff477eb0314ce2e307742b', 'request_id': 'req-49a5af2f-97e9-4d91-99cc-bc5deb787c89'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:38.540354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e143bfbb72ff477eb0314ce2e307742b', 'request_id': 'req-49a5af2f-97e9-4d91-99cc-bc5deb787c89'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:38.553688 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] The token cache is being invalidate because project e143bfbb72ff477eb0314ce2e307742b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:38.556656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:38.556656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-49a5af2f-97e9-4d91-99cc-bc5deb787c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:38.556656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1271/2550] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:38 2022] DELETE /identity/v3/projects/e143bfbb72ff477eb0314ce2e307742b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:38.561444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d06d8-e518-4b74-94d1-84921278559c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:38.561734 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d06d8-e518-4b74-94d1-84921278559c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:38.562013 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d06d8-e518-4b74-94d1-84921278559c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:38.580442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-359d06d8-e518-4b74-94d1-84921278559c None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:38.591262 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-359d06d8-e518-4b74-94d1-84921278559c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:38.641411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1280/2551] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:38.649789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7774a93-e117-460e-bb3e-2e2e88be30c0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:38.654318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7774a93-e117-460e-bb3e-2e2e88be30c0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:38.654318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7774a93-e117-460e-bb3e-2e2e88be30c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:38.673025 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b7774a93-e117-460e-bb3e-2e2e88be30c0 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:38.673025 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b7774a93-e117-460e-bb3e-2e2e88be30c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:38.679121 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1272/2552] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:38.684578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d06d8-e518-4b74-94d1-84921278559c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:38.693621 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d06d8-e518-4b74-94d1-84921278559c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:38.698257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3857f6-109d-41dc-8fc3-b015b3241698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:38.698911 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3857f6-109d-41dc-8fc3-b015b3241698 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:38.699191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3857f6-109d-41dc-8fc3-b015b3241698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:38.699460 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3857f6-109d-41dc-8fc3-b015b3241698 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:38.700182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3857f6-109d-41dc-8fc3-b015b3241698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:32:38.700483 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3857f6-109d-41dc-8fc3-b015b3241698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:38.702609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3857f6-109d-41dc-8fc3-b015b3241698 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:38.716308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1281/2553] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:32:38.720535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7774a93-e117-460e-bb3e-2e2e88be30c0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:38.730294 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7774a93-e117-460e-bb3e-2e2e88be30c0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:38.738295 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3b6d4-d7a7-4625-9c3a-a6d0bbf2b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:38.739035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3b6d4-d7a7-4625-9c3a-a6d0bbf2b6df admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:38.739317 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3b6d4-d7a7-4625-9c3a-a6d0bbf2b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:38.739589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3b6d4-d7a7-4625-9c3a-a6d0bbf2b6df admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:38.740279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3b6d4-d7a7-4625-9c3a-a6d0bbf2b6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:38.742192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3b6d4-d7a7-4625-9c3a-a6d0bbf2b6df admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:38.840783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1273/2554] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:38 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:38.844984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3857f6-109d-41dc-8fc3-b015b3241698 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:38.856112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3857f6-109d-41dc-8fc3-b015b3241698 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:38.920330 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f15a13-8e45-4084-9147-926def3bd20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:38.921065 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f15a13-8e45-4084-9147-926def3bd20f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:38.921352 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f15a13-8e45-4084-9147-926def3bd20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:38.921633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f15a13-8e45-4084-9147-926def3bd20f admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:38.922321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f15a13-8e45-4084-9147-926def3bd20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:38.924388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f15a13-8e45-4084-9147-926def3bd20f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:39.014927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1282/2555] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:38 2022] POST /identity/v3/users => generated 303 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:39.017558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3b6d4-d7a7-4625-9c3a-a6d0bbf2b6df admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:39.029588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3b6d4-d7a7-4625-9c3a-a6d0bbf2b6df admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:39.034456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f1b1d-a816-4662-9030-435cdc083cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:39.037937 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1b1d-a816-4662-9030-435cdc083cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:39.037937 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1b1d-a816-4662-9030-435cdc083cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:39.037937 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1b1d-a816-4662-9030-435cdc083cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:39.037937 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f1b1d-a816-4662-9030-435cdc083cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:39.038277 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f1b1d-a816-4662-9030-435cdc083cf0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:39.048692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1274/2556] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:39.052811 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f15a13-8e45-4084-9147-926def3bd20f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:39.062759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f15a13-8e45-4084-9147-926def3bd20f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:39.068430 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c072a-8fcc-4021-8dc3-b81e3e7c140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:39.069102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c072a-8fcc-4021-8dc3-b81e3e7c140e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:39.069383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c072a-8fcc-4021-8dc3-b81e3e7c140e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:39.069661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c072a-8fcc-4021-8dc3-b81e3e7c140e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:39.070376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c072a-8fcc-4021-8dc3-b81e3e7c140e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:39.071952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c072a-8fcc-4021-8dc3-b81e3e7c140e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:39.082610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1283/2557] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:39.086720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f1b1d-a816-4662-9030-435cdc083cf0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:39.096453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f1b1d-a816-4662-9030-435cdc083cf0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:39.102386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55803f04-70a7-4692-b0c5-9344cf9852ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:39.102386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55803f04-70a7-4692-b0c5-9344cf9852ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:39.102628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55803f04-70a7-4692-b0c5-9344cf9852ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:39.102823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55803f04-70a7-4692-b0c5-9344cf9852ad admin admin] PATH_INFO: `/v3/projects/8c3aab2b4ead4d30897589ee9e4f62df/users/5c7b59dfa94040f2a33c2ac92b6911a1/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:39.116951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55803f04-70a7-4692-b0c5-9344cf9852ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3aab2b4ead4d30897589ee9e4f62df, user_id=5c7b59dfa94040f2a33c2ac92b6911a1, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:39.119703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55803f04-70a7-4692-b0c5-9344cf9852ad admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:39.186970 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1275/2558] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:39 2022] PUT /identity/v3/projects/8c3aab2b4ead4d30897589ee9e4f62df/users/5c7b59dfa94040f2a33c2ac92b6911a1/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:39.197645 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b70c6a-bbb0-475a-bed7-b95e09245163 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:39.197933 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b70c6a-bbb0-475a-bed7-b95e09245163 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:39.198208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b70c6a-bbb0-475a-bed7-b95e09245163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:39.226407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-65b70c6a-bbb0-475a-bed7-b95e09245163 None None] MFA Rules not processed for user `5c7b59dfa94040f2a33c2ac92b6911a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:39.227614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-65b70c6a-bbb0-475a-bed7-b95e09245163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:39.291109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1284/2559] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:39.295723 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55803f04-70a7-4692-b0c5-9344cf9852ad admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:39.358612 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55803f04-70a7-4692-b0c5-9344cf9852ad admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:39.364040 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ffff9-859f-4f81-87c7-d7e4c27c73a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:39.364698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ffff9-859f-4f81-87c7-d7e4c27c73a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:39.365008 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ffff9-859f-4f81-87c7-d7e4c27c73a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:39.365284 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ffff9-859f-4f81-87c7-d7e4c27c73a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:39.365974 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ffff9-859f-4f81-87c7-d7e4c27c73a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:39.368555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ffff9-859f-4f81-87c7-d7e4c27c73a2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:39.507715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1276/2560] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:39 2022] POST /identity/v3/projects => generated 403 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:39.509068 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b70c6a-bbb0-475a-bed7-b95e09245163 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:39.520608 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b70c6a-bbb0-475a-bed7-b95e09245163 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:39.581339 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e097eca-3f91-49a6-825c-df72e8b8465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:39.582038 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e097eca-3f91-49a6-825c-df72e8b8465c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:39.582320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e097eca-3f91-49a6-825c-df72e8b8465c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:39.582596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e097eca-3f91-49a6-825c-df72e8b8465c admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:39.583301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e097eca-3f91-49a6-825c-df72e8b8465c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:39.585286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e097eca-3f91-49a6-825c-df72e8b8465c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:39.707341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1285/2561] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:39 2022] POST /identity/v3/users => generated 308 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:32:39.708441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ffff9-859f-4f81-87c7-d7e4c27c73a2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:39.718729 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ffff9-859f-4f81-87c7-d7e4c27c73a2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:39.723942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ec19-7a71-4833-9318-c470257d9f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:39.724600 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ec19-7a71-4833-9318-c470257d9f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:39.724886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ec19-7a71-4833-9318-c470257d9f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:39.725189 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ec19-7a71-4833-9318-c470257d9f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:39.725914 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ec19-7a71-4833-9318-c470257d9f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:39.727493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ec19-7a71-4833-9318-c470257d9f2e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:39.739541 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1277/2562] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:39.743739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e097eca-3f91-49a6-825c-df72e8b8465c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:39.753741 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e097eca-3f91-49a6-825c-df72e8b8465c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:39.758375 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c81e7b-4754-4c18-b059-c68901dfb137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:39.759248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c81e7b-4754-4c18-b059-c68901dfb137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:39.759526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c81e7b-4754-4c18-b059-c68901dfb137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:39.759798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c81e7b-4754-4c18-b059-c68901dfb137 admin admin] PATH_INFO: `/v3/projects/ecbbc994989a47098d51b5e6487e82d7/users/94071baa05e045079f6feaa5962bd33b/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:39.774394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c81e7b-4754-4c18-b059-c68901dfb137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbbc994989a47098d51b5e6487e82d7, user_id=94071baa05e045079f6feaa5962bd33b, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:39.777133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c81e7b-4754-4c18-b059-c68901dfb137 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:39.844304 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1286/2563] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:39 2022] PUT /identity/v3/projects/ecbbc994989a47098d51b5e6487e82d7/users/94071baa05e045079f6feaa5962bd33b/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:32:39.849824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ec19-7a71-4833-9318-c470257d9f2e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:39.868084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ec19-7a71-4833-9318-c470257d9f2e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:39.944503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbedd04-7a82-4899-b383-2cdd7e3d230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:39.945202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbedd04-7a82-4899-b383-2cdd7e3d230b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:39.945783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbedd04-7a82-4899-b383-2cdd7e3d230b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:39.945783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbedd04-7a82-4899-b383-2cdd7e3d230b admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:39.946464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbedd04-7a82-4899-b383-2cdd7e3d230b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:39.948065 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbedd04-7a82-4899-b383-2cdd7e3d230b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:39.958605 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1278/2564] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:39.962839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c81e7b-4754-4c18-b059-c68901dfb137 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:39.974232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c81e7b-4754-4c18-b059-c68901dfb137 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:39.978938 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61a892-fcb1-41ec-a67b-88afd5934878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:39.979826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a892-fcb1-41ec-a67b-88afd5934878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:39.980157 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a892-fcb1-41ec-a67b-88afd5934878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:39.980439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a892-fcb1-41ec-a67b-88afd5934878 admin admin] PATH_INFO: `/v3/projects/ecbbc994989a47098d51b5e6487e82d7/users/94071baa05e045079f6feaa5962bd33b/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:39.982518 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61a892-fcb1-41ec-a67b-88afd5934878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbbc994989a47098d51b5e6487e82d7, user_id=94071baa05e045079f6feaa5962bd33b, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:39.985156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61a892-fcb1-41ec-a67b-88afd5934878 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:39.996511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1287/2565] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:39 2022] PUT /identity/v3/projects/ecbbc994989a47098d51b5e6487e82d7/users/94071baa05e045079f6feaa5962bd33b/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:40.008153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5d300-8807-4dc6-8a62-f64a33764911 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:40.008444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5d300-8807-4dc6-8a62-f64a33764911 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:40.008720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5d300-8807-4dc6-8a62-f64a33764911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:40.035310 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0de5d300-8807-4dc6-8a62-f64a33764911 None None] MFA Rules not processed for user `94071baa05e045079f6feaa5962bd33b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:40.036512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0de5d300-8807-4dc6-8a62-f64a33764911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:40.105926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1279/2566] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:40.116807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61a892-fcb1-41ec-a67b-88afd5934878 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:40.118615 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5a61a892-fcb1-41ec-a67b-88afd5934878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:40.176290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61a892-fcb1-41ec-a67b-88afd5934878 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:40.179960 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed0b53-0404-4ca4-960a-761d8b86f666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:40.180599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0b53-0404-4ca4-960a-761d8b86f666 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:40.180882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0b53-0404-4ca4-960a-761d8b86f666 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:40.181184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0b53-0404-4ca4-960a-761d8b86f666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:40.189912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed0b53-0404-4ca4-960a-761d8b86f666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:40.191376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed0b53-0404-4ca4-960a-761d8b86f666 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:40.201301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1288/2567] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:40.329933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5d300-8807-4dc6-8a62-f64a33764911 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:40.392993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5d300-8807-4dc6-8a62-f64a33764911 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:40.398476 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:40.399553 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:40.399842 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:40.400140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] PATH_INFO: `/v3/users/5c7b59dfa94040f2a33c2ac92b6911a1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:40.401401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7b59dfa94040f2a33c2ac92b6911a1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:40.403427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:40.654504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7b59dfa94040f2a33c2ac92b6911a1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:40.666199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7b59dfa94040f2a33c2ac92b6911a1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:40.740998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7b59dfa94040f2a33c2ac92b6911a1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:40.748678 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7b59dfa94040f2a33c2ac92b6911a1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:40.749313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7b59dfa94040f2a33c2ac92b6911a1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:40.756109 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1280/2568] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:40 2022] DELETE /identity/v3/users/5c7b59dfa94040f2a33c2ac92b6911a1 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:40.760371 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161e606-b248-45f3-bef3-fa2bb668c95e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:40.761342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161e606-b248-45f3-bef3-fa2bb668c95e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:40.761631 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161e606-b248-45f3-bef3-fa2bb668c95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:40.780809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f161e606-b248-45f3-bef3-fa2bb668c95e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:40.782057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f161e606-b248-45f3-bef3-fa2bb668c95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:40.841360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1289/2569] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:40.851526 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:40.853053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:40.912917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a38b-deb3-49ec-ab58-b2925121870b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:40.916524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019352f5-2a64-4037-87b4-fa1787787476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:40.917213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019352f5-2a64-4037-87b4-fa1787787476 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:40.917499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019352f5-2a64-4037-87b4-fa1787787476 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:40.917774 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019352f5-2a64-4037-87b4-fa1787787476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:40.927422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019352f5-2a64-4037-87b4-fa1787787476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:40.928856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019352f5-2a64-4037-87b4-fa1787787476 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:40.938416 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1281/2570] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:41.349117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161e606-b248-45f3-bef3-fa2bb668c95e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:41.350716 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f161e606-b248-45f3-bef3-fa2bb668c95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:41.363626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161e606-b248-45f3-bef3-fa2bb668c95e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:41.375618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:41.375618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:41.375618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:41.375618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] PATH_INFO: `/v3/projects/8c3aab2b4ead4d30897589ee9e4f62df` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:41.376487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3aab2b4ead4d30897589ee9e4f62df)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:41.376487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:41.486782 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3aab2b4ead4d30897589ee9e4f62df', 'request_id': 'req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:41.578342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3aab2b4ead4d30897589ee9e4f62df', 'request_id': 'req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:41.592250 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3aab2b4ead4d30897589ee9e4f62df', 'request_id': 'req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:41.596006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] The token cache is being invalidate because project 8c3aab2b4ead4d30897589ee9e4f62df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:41.597138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:41.597884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:41.599432 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1290/2571] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:41 2022] DELETE /identity/v3/projects/8c3aab2b4ead4d30897589ee9e4f62df => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:41.603551 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019352f5-2a64-4037-87b4-fa1787787476 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:41.613738 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019352f5-2a64-4037-87b4-fa1787787476 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:41.671868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c789fc-b902-489c-9c2d-7552c38f137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:41.672745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c789fc-b902-489c-9c2d-7552c38f137d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:41.673053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c789fc-b902-489c-9c2d-7552c38f137d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:41.673336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c789fc-b902-489c-9c2d-7552c38f137d admin admin] PATH_INFO: `/v3/users/94071baa05e045079f6feaa5962bd33b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:41.674771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c789fc-b902-489c-9c2d-7552c38f137d admin admin] RBAC: Authorizing `identity:delete_user(user_id=94071baa05e045079f6feaa5962bd33b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:41.676930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c789fc-b902-489c-9c2d-7552c38f137d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:41.896906 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-12c789fc-b902-489c-9c2d-7552c38f137d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94071baa05e045079f6feaa5962bd33b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:41.910029 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-12c789fc-b902-489c-9c2d-7552c38f137d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94071baa05e045079f6feaa5962bd33b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:41.989518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-12c789fc-b902-489c-9c2d-7552c38f137d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94071baa05e045079f6feaa5962bd33b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:41.996954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-12c789fc-b902-489c-9c2d-7552c38f137d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94071baa05e045079f6feaa5962bd33b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:41.997627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-12c789fc-b902-489c-9c2d-7552c38f137d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94071baa05e045079f6feaa5962bd33b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:42.004591 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1282/2572] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:41 2022] DELETE /identity/v3/users/94071baa05e045079f6feaa5962bd33b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:42.428504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:42.430051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:42.458218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e9716-832b-4340-8c9f-0ea09df6f4a3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:42.520520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:42.521406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:42.521688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:42.521986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] PATH_INFO: `/v3/projects/ecbbc994989a47098d51b5e6487e82d7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:42.523208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbbc994989a47098d51b5e6487e82d7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:42.525153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:42.630659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbbc994989a47098d51b5e6487e82d7', 'request_id': 'req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:42.692539 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbbc994989a47098d51b5e6487e82d7', 'request_id': 'req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:42.699295 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbbc994989a47098d51b5e6487e82d7', 'request_id': 'req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:42.710391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] The token cache is being invalidate because project ecbbc994989a47098d51b5e6487e82d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:42.710708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:42.711375 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8c59fb66-6a1f-4641-b9cc-06bf7a2626f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:42.713117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1291/2573] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:42 2022] DELETE /identity/v3/projects/ecbbc994989a47098d51b5e6487e82d7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:42.719086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4fe64-8920-437c-bc23-8a2ced485242 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:42.719473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4fe64-8920-437c-bc23-8a2ced485242 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:42.719647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4fe64-8920-437c-bc23-8a2ced485242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:42.739041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9ba4fe64-8920-437c-bc23-8a2ced485242 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:42.740610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9ba4fe64-8920-437c-bc23-8a2ced485242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:42.802003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1283/2574] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:42.810182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35250caf-528e-4b9a-8096-15fd53a5ce85 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:42.810473 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35250caf-528e-4b9a-8096-15fd53a5ce85 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:42.810765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35250caf-528e-4b9a-8096-15fd53a5ce85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:42.829498 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-35250caf-528e-4b9a-8096-15fd53a5ce85 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:42.830802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-35250caf-528e-4b9a-8096-15fd53a5ce85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:42.839635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1292/2575] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:42.843988 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4fe64-8920-437c-bc23-8a2ced485242 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:42.854144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4fe64-8920-437c-bc23-8a2ced485242 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:42.858672 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ca94f-3279-46e8-87dc-ecc98ac6cd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:42.859321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ca94f-3279-46e8-87dc-ecc98ac6cd2e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:42.859600 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ca94f-3279-46e8-87dc-ecc98ac6cd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:42.859872 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ca94f-3279-46e8-87dc-ecc98ac6cd2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:42.860588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ca94f-3279-46e8-87dc-ecc98ac6cd2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:32:42.860895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ca94f-3279-46e8-87dc-ecc98ac6cd2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:42.863203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ca94f-3279-46e8-87dc-ecc98ac6cd2e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:42.874344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1284/2576] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:32:42.878831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35250caf-528e-4b9a-8096-15fd53a5ce85 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:42.887972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35250caf-528e-4b9a-8096-15fd53a5ce85 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:42.893323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee64254-617a-4a5e-a1ca-8ca5f107d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:42.894438 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee64254-617a-4a5e-a1ca-8ca5f107d1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:42.894928 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee64254-617a-4a5e-a1ca-8ca5f107d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:42.895278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee64254-617a-4a5e-a1ca-8ca5f107d1d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:42.896497 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee64254-617a-4a5e-a1ca-8ca5f107d1d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:42.899505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee64254-617a-4a5e-a1ca-8ca5f107d1d4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:42.987732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1293/2577] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:42 2022] POST /identity/v3/projects => generated 409 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:42.992512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ca94f-3279-46e8-87dc-ecc98ac6cd2e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:43.003339 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ca94f-3279-46e8-87dc-ecc98ac6cd2e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:43.062194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00135b-e32d-459a-8156-0259ddcf5251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:43.062866 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00135b-e32d-459a-8156-0259ddcf5251 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:43.063150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00135b-e32d-459a-8156-0259ddcf5251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:43.063427 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00135b-e32d-459a-8156-0259ddcf5251 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:43.064115 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00135b-e32d-459a-8156-0259ddcf5251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:43.066194 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00135b-e32d-459a-8156-0259ddcf5251 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:43.163311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1285/2578] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:42 2022] POST /identity/v3/users => generated 305 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:43.163612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee64254-617a-4a5e-a1ca-8ca5f107d1d4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:43.174108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee64254-617a-4a5e-a1ca-8ca5f107d1d4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:43.179462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055a518-42e6-496d-a743-34c456943bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:43.180172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055a518-42e6-496d-a743-34c456943bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:43.180473 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055a518-42e6-496d-a743-34c456943bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:43.180773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055a518-42e6-496d-a743-34c456943bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:43.181575 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055a518-42e6-496d-a743-34c456943bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:43.183283 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055a518-42e6-496d-a743-34c456943bc5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:43.195224 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1294/2579] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:43.199095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00135b-e32d-459a-8156-0259ddcf5251 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:43.210041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00135b-e32d-459a-8156-0259ddcf5251 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:43.214782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513cf4d-59cb-4c67-9b2b-4d995e265fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:43.215441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513cf4d-59cb-4c67-9b2b-4d995e265fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:43.215727 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513cf4d-59cb-4c67-9b2b-4d995e265fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:43.216007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513cf4d-59cb-4c67-9b2b-4d995e265fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:43.216750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513cf4d-59cb-4c67-9b2b-4d995e265fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:43.218387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513cf4d-59cb-4c67-9b2b-4d995e265fc8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:43.230660 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1286/2580] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:43.234776 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055a518-42e6-496d-a743-34c456943bc5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:43.244660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055a518-42e6-496d-a743-34c456943bc5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:43.249258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37214ae5-a7c0-4116-bcda-659be0b9d6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:43.250128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37214ae5-a7c0-4116-bcda-659be0b9d6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:43.250413 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37214ae5-a7c0-4116-bcda-659be0b9d6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:43.250685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37214ae5-a7c0-4116-bcda-659be0b9d6f2 admin admin] PATH_INFO: `/v3/projects/69376fc347214e63b731ff3a1c0e1331/users/773c667c847448b397c5f0cce73e97bb/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:43.265214 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37214ae5-a7c0-4116-bcda-659be0b9d6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69376fc347214e63b731ff3a1c0e1331, user_id=773c667c847448b397c5f0cce73e97bb, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:43.267835 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37214ae5-a7c0-4116-bcda-659be0b9d6f2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:43.347490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1295/2581] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:43 2022] PUT /identity/v3/projects/69376fc347214e63b731ff3a1c0e1331/users/773c667c847448b397c5f0cce73e97bb/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:43.357661 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74c54-e930-443e-9ac5-0e0eed8a0d9d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:43.357953 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74c54-e930-443e-9ac5-0e0eed8a0d9d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:43.358231 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74c54-e930-443e-9ac5-0e0eed8a0d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:43.384620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5bf74c54-e930-443e-9ac5-0e0eed8a0d9d None None] MFA Rules not processed for user `773c667c847448b397c5f0cce73e97bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:43.385849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5bf74c54-e930-443e-9ac5-0e0eed8a0d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:43.448314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1287/2582] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:43.453070 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37214ae5-a7c0-4116-bcda-659be0b9d6f2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:43.550388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37214ae5-a7c0-4116-bcda-659be0b9d6f2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:43.550388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd36e19-d319-4d83-9838-785ade7c3f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:43.550388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd36e19-d319-4d83-9838-785ade7c3f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:43.550388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd36e19-d319-4d83-9838-785ade7c3f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:43.550908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd36e19-d319-4d83-9838-785ade7c3f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:43.550908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd36e19-d319-4d83-9838-785ade7c3f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:43.550908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd36e19-d319-4d83-9838-785ade7c3f5a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:43.645792 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1296/2583] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:43 2022] POST /identity/v3/projects => generated 409 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:43.649845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf74c54-e930-443e-9ac5-0e0eed8a0d9d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:43.660484 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf74c54-e930-443e-9ac5-0e0eed8a0d9d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:43.717002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148eaa08-6d46-4a48-8af7-51dfa7284e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:43.717683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eaa08-6d46-4a48-8af7-51dfa7284e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:43.717965 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eaa08-6d46-4a48-8af7-51dfa7284e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:43.718247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eaa08-6d46-4a48-8af7-51dfa7284e03 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:43.718936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148eaa08-6d46-4a48-8af7-51dfa7284e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:43.720839 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148eaa08-6d46-4a48-8af7-51dfa7284e03 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:43.824321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1288/2584] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:43 2022] POST /identity/v3/users => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:43.828659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd36e19-d319-4d83-9838-785ade7c3f5a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:43.839804 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd36e19-d319-4d83-9838-785ade7c3f5a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:43.844466 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad03b2f-ce33-4e76-81d4-5533ec76af8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:43.845200 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad03b2f-ce33-4e76-81d4-5533ec76af8c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:43.845484 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad03b2f-ce33-4e76-81d4-5533ec76af8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:43.845757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad03b2f-ce33-4e76-81d4-5533ec76af8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:43.847225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad03b2f-ce33-4e76-81d4-5533ec76af8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:43.849112 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad03b2f-ce33-4e76-81d4-5533ec76af8c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:43.859710 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1297/2585] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:43.864275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148eaa08-6d46-4a48-8af7-51dfa7284e03 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:43.874136 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148eaa08-6d46-4a48-8af7-51dfa7284e03 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:43.878922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e748d-19a5-4d9a-9157-e0d4225af56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:43.879790 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e748d-19a5-4d9a-9157-e0d4225af56a admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:43.880076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e748d-19a5-4d9a-9157-e0d4225af56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:43.880352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e748d-19a5-4d9a-9157-e0d4225af56a admin admin] PATH_INFO: `/v3/projects/91d8e86e0f614ade8fb9ee1733f118c3/users/06cbc7e2d4ad412eb7bdeab376a13abd/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:43.895141 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e748d-19a5-4d9a-9157-e0d4225af56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d8e86e0f614ade8fb9ee1733f118c3, user_id=06cbc7e2d4ad412eb7bdeab376a13abd, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:43.897823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e748d-19a5-4d9a-9157-e0d4225af56a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:44.076148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1289/2586] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:43 2022] PUT /identity/v3/projects/91d8e86e0f614ade8fb9ee1733f118c3/users/06cbc7e2d4ad412eb7bdeab376a13abd/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:44.079639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad03b2f-ce33-4e76-81d4-5533ec76af8c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:44.089976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad03b2f-ce33-4e76-81d4-5533ec76af8c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:44.144987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5f385-489b-4a7e-98e5-a69382213ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:44.145640 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5f385-489b-4a7e-98e5-a69382213ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:44.145925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5f385-489b-4a7e-98e5-a69382213ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:44.146203 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5f385-489b-4a7e-98e5-a69382213ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:44.146921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5f385-489b-4a7e-98e5-a69382213ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:44.148541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5f385-489b-4a7e-98e5-a69382213ae7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:44.158157 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1298/2587] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:44.162964 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e748d-19a5-4d9a-9157-e0d4225af56a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:44.173568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e748d-19a5-4d9a-9157-e0d4225af56a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:44.178489 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c7ea-8aae-488c-8d58-ec548727724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:44.179373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c7ea-8aae-488c-8d58-ec548727724c admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:44.179656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c7ea-8aae-488c-8d58-ec548727724c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:44.179934 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c7ea-8aae-488c-8d58-ec548727724c admin admin] PATH_INFO: `/v3/projects/91d8e86e0f614ade8fb9ee1733f118c3/users/06cbc7e2d4ad412eb7bdeab376a13abd/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:44.181962 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42c7ea-8aae-488c-8d58-ec548727724c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d8e86e0f614ade8fb9ee1733f118c3, user_id=06cbc7e2d4ad412eb7bdeab376a13abd, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:44.184577 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42c7ea-8aae-488c-8d58-ec548727724c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:44.195851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1290/2588] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:44 2022] PUT /identity/v3/projects/91d8e86e0f614ade8fb9ee1733f118c3/users/06cbc7e2d4ad412eb7bdeab376a13abd/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:44.208320 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f3b27-da84-4851-ab45-f38fc3e6ba9d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:44.208617 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f3b27-da84-4851-ab45-f38fc3e6ba9d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:44.208978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f3b27-da84-4851-ab45-f38fc3e6ba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:44.238333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-995f3b27-da84-4851-ab45-f38fc3e6ba9d None None] MFA Rules not processed for user `06cbc7e2d4ad412eb7bdeab376a13abd`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:44.239551 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-995f3b27-da84-4851-ab45-f38fc3e6ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:44.306904 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1299/2589] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:44.318282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c7ea-8aae-488c-8d58-ec548727724c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:44.319948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7a42c7ea-8aae-488c-8d58-ec548727724c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:44.378463 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c7ea-8aae-488c-8d58-ec548727724c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:44.382352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f5f6b-e31e-42fe-a2b6-9d3f1f1fe153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:44.383046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f5f6b-e31e-42fe-a2b6-9d3f1f1fe153 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:44.383364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f5f6b-e31e-42fe-a2b6-9d3f1f1fe153 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:44.383659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f5f6b-e31e-42fe-a2b6-9d3f1f1fe153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:44.394398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f5f6b-e31e-42fe-a2b6-9d3f1f1fe153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:44.395825 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f5f6b-e31e-42fe-a2b6-9d3f1f1fe153 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:44.405252 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1291/2590] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:44.829637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f3b27-da84-4851-ab45-f38fc3e6ba9d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:44.840033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f3b27-da84-4851-ab45-f38fc3e6ba9d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:44.843705 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b36073-8cfd-4dbf-b1b2-6cadd12464e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:44.844362 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b36073-8cfd-4dbf-b1b2-6cadd12464e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:44.844638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b36073-8cfd-4dbf-b1b2-6cadd12464e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:44.844905 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b36073-8cfd-4dbf-b1b2-6cadd12464e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:44.905245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b36073-8cfd-4dbf-b1b2-6cadd12464e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:44.906667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b36073-8cfd-4dbf-b1b2-6cadd12464e7 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:44.915381 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1300/2591] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:55.082130 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f5f6b-e31e-42fe-a2b6-9d3f1f1fe153 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:55.143106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f5f6b-e31e-42fe-a2b6-9d3f1f1fe153 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:55.147924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:55.148782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:55.149095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:55.149372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] PATH_INFO: `/v3/users/773c667c847448b397c5f0cce73e97bb` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:55.150598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773c667c847448b397c5f0cce73e97bb)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:55.152491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:55.360415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773c667c847448b397c5f0cce73e97bb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:55.374556 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773c667c847448b397c5f0cce73e97bb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:55.441554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773c667c847448b397c5f0cce73e97bb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:55.449927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773c667c847448b397c5f0cce73e97bb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:55.450662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773c667c847448b397c5f0cce73e97bb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:55.457537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1292/2592] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:55 2022] DELETE /identity/v3/users/773c667c847448b397c5f0cce73e97bb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:32:55.470067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641928-abd4-4e34-bdd8-fc6ac0b3ed13 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:55.470659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641928-abd4-4e34-bdd8-fc6ac0b3ed13 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:55.470659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641928-abd4-4e34-bdd8-fc6ac0b3ed13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:55.489863 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2a641928-abd4-4e34-bdd8-fc6ac0b3ed13 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:55.491117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2a641928-abd4-4e34-bdd8-fc6ac0b3ed13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:55.557222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1301/2593] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:55.582359 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:55.583726 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:55.653242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20d82-63a8-4e20-b6ea-11271f71b7b1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:55.656896 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2001e3-ced8-4dfe-a986-a0f5da2efd6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:55.657597 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2001e3-ced8-4dfe-a986-a0f5da2efd6d service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:55.657875 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2001e3-ced8-4dfe-a986-a0f5da2efd6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:55.658151 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2001e3-ced8-4dfe-a986-a0f5da2efd6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:55.674011 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2001e3-ced8-4dfe-a986-a0f5da2efd6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:55.676161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2001e3-ced8-4dfe-a986-a0f5da2efd6d service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:55.686279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1293/2594] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:32:56.492156 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a641928-abd4-4e34-bdd8-fc6ac0b3ed13 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:56.495333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2a641928-abd4-4e34-bdd8-fc6ac0b3ed13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:56.541386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a641928-abd4-4e34-bdd8-fc6ac0b3ed13 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:56.578158 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:56.579550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:56.581431 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:56.585287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] PATH_INFO: `/v3/projects/69376fc347214e63b731ff3a1c0e1331` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:56.587656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69376fc347214e63b731ff3a1c0e1331)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:56.589796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:56.805419 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69376fc347214e63b731ff3a1c0e1331', 'request_id': 'req-cd490dae-65de-4248-86f6-db790cda6da1'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:56.890227 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69376fc347214e63b731ff3a1c0e1331', 'request_id': 'req-cd490dae-65de-4248-86f6-db790cda6da1'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:56.898469 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69376fc347214e63b731ff3a1c0e1331', 'request_id': 'req-cd490dae-65de-4248-86f6-db790cda6da1'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:56.913408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] The token cache is being invalidate because project 69376fc347214e63b731ff3a1c0e1331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:56.913705 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:56.914669 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:56.917045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1302/2595] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:56 2022] DELETE /identity/v3/projects/69376fc347214e63b731ff3a1c0e1331 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:56.921543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2001e3-ced8-4dfe-a986-a0f5da2efd6d service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:56.933884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2001e3-ced8-4dfe-a986-a0f5da2efd6d service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:57.028946 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:57.030205 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:57.030488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:57.030767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] PATH_INFO: `/v3/users/06cbc7e2d4ad412eb7bdeab376a13abd` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:57.032325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06cbc7e2d4ad412eb7bdeab376a13abd)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:57.035019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:57.352195 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06cbc7e2d4ad412eb7bdeab376a13abd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:57.366119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06cbc7e2d4ad412eb7bdeab376a13abd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:57.461091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06cbc7e2d4ad412eb7bdeab376a13abd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:57.469829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06cbc7e2d4ad412eb7bdeab376a13abd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:57.470945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06cbc7e2d4ad412eb7bdeab376a13abd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:57.477610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1294/2596] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:56 2022] DELETE /identity/v3/users/06cbc7e2d4ad412eb7bdeab376a13abd => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:57.603372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:57.605367 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:57.623113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd490dae-65de-4248-86f6-db790cda6da1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:57.704046 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9da0c0-9a8a-4c52-af11-7b3752db04d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:57.705869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9da0c0-9a8a-4c52-af11-7b3752db04d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:57.706427 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9da0c0-9a8a-4c52-af11-7b3752db04d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:57.707067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9da0c0-9a8a-4c52-af11-7b3752db04d1 admin admin] PATH_INFO: `/v3/users/996b3ddd20744e19b9fffee0aba52903` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:57.708526 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9da0c0-9a8a-4c52-af11-7b3752db04d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996b3ddd20744e19b9fffee0aba52903)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:57.711260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9da0c0-9a8a-4c52-af11-7b3752db04d1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:57.967302 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7c9da0c0-9a8a-4c52-af11-7b3752db04d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996b3ddd20744e19b9fffee0aba52903'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:57.980294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7c9da0c0-9a8a-4c52-af11-7b3752db04d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996b3ddd20744e19b9fffee0aba52903'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:57.981039 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7c9da0c0-9a8a-4c52-af11-7b3752db04d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996b3ddd20744e19b9fffee0aba52903'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:57.988634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7c9da0c0-9a8a-4c52-af11-7b3752db04d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996b3ddd20744e19b9fffee0aba52903'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:57.989412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7c9da0c0-9a8a-4c52-af11-7b3752db04d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996b3ddd20744e19b9fffee0aba52903'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:58.027665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:58.029170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:58.044823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d945f1a-2aa2-43db-899e-590a80342047 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:58.054885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:58.056267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.056631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.056991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] PATH_INFO: `/v3/projects/91d8e86e0f614ade8fb9ee1733f118c3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.058948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d8e86e0f614ade8fb9ee1733f118c3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:58.064458 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:58.128342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1303/2597] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:32:57 2022] DELETE /identity/v3/users/996b3ddd20744e19b9fffee0aba52903 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:58.132867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2613-d419-450a-a07a-0e120a2594f7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.133215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2613-d419-450a-a07a-0e120a2594f7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.133496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2613-d419-450a-a07a-0e120a2594f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.159811 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a36d2613-d419-450a-a07a-0e120a2594f7 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:58.159811 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a36d2613-d419-450a-a07a-0e120a2594f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:58.217920 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1304/2598] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:58.219069 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ab3b5-f64d-4c46-93ca-3b8e3e202aae None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.219361 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ab3b5-f64d-4c46-93ca-3b8e3e202aae None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.219644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ab3b5-f64d-4c46-93ca-3b8e3e202aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.239451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9e6ab3b5-f64d-4c46-93ca-3b8e3e202aae None None] MFA Rules not processed for user `590232e0efa742f1a4c273259fd2531b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:58.240636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9e6ab3b5-f64d-4c46-93ca-3b8e3e202aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:58.281470 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d8e86e0f614ade8fb9ee1733f118c3', 'request_id': 'req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:58.293665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1305/2599] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:58.294618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ab3b5-f64d-4c46-93ca-3b8e3e202aae None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:58.295864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9e6ab3b5-f64d-4c46-93ca-3b8e3e202aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:58.360333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ab3b5-f64d-4c46-93ca-3b8e3e202aae None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:58.366484 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d8e86e0f614ade8fb9ee1733f118c3', 'request_id': 'req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:58.378190 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d8e86e0f614ade8fb9ee1733f118c3', 'request_id': 'req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:58.386463 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] The token cache is being invalidate because project 91d8e86e0f614ade8fb9ee1733f118c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:58.386755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:58.387429 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-41aa1e8f-c0fb-4ccc-8aad-a04fa12921dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:58.389148 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1295/2600] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:58 2022] DELETE /identity/v3/projects/91d8e86e0f614ade8fb9ee1733f118c3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:32:58.394118 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db88ca9-15c1-4e0b-abac-2fdbe96c858b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.394411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db88ca9-15c1-4e0b-abac-2fdbe96c858b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.395061 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db88ca9-15c1-4e0b-abac-2fdbe96c858b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.417184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5db88ca9-15c1-4e0b-abac-2fdbe96c858b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:58.417777 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7e43f-2ef2-47c6-abe3-abd6e95fbe56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:58.418447 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7e43f-2ef2-47c6-abe3-abd6e95fbe56 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.418565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5db88ca9-15c1-4e0b-abac-2fdbe96c858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:58.423703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7e43f-2ef2-47c6-abe3-abd6e95fbe56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.423703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7e43f-2ef2-47c6-abe3-abd6e95fbe56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.423703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-60a7e43f-2ef2-47c6-abe3-abd6e95fbe56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:58.489355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1296/2601] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:58.498443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869144-336c-46a3-bb7d-580445139ce3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.498688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7e43f-2ef2-47c6-abe3-abd6e95fbe56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:58.498916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869144-336c-46a3-bb7d-580445139ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.499370 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869144-336c-46a3-bb7d-580445139ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.500456 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7e43f-2ef2-47c6-abe3-abd6e95fbe56 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:58.513448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1306/2602] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:58.537776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-27869144-336c-46a3-bb7d-580445139ce3 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:58.539366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-27869144-336c-46a3-bb7d-580445139ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:58.554292 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1297/2603] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:58.559273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7e43f-2ef2-47c6-abe3-abd6e95fbe56 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:58.570425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7e43f-2ef2-47c6-abe3-abd6e95fbe56 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:58.576332 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c8ac7-2039-4ff2-bd49-8775d0a15c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:58.577159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c8ac7-2039-4ff2-bd49-8775d0a15c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.577508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c8ac7-2039-4ff2-bd49-8775d0a15c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.577845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c8ac7-2039-4ff2-bd49-8775d0a15c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.578680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c8ac7-2039-4ff2-bd49-8775d0a15c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:32:58.579049 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c8ac7-2039-4ff2-bd49-8775d0a15c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:58.582000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c8ac7-2039-4ff2-bd49-8775d0a15c32 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:58.595661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1307/2604] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:32:58.600919 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27869144-336c-46a3-bb7d-580445139ce3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:58.612035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27869144-336c-46a3-bb7d-580445139ce3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:58.617705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e02a45-7c29-429b-abf0-16e8ceb6b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:58.618902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e02a45-7c29-429b-abf0-16e8ceb6b098 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.619382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e02a45-7c29-429b-abf0-16e8ceb6b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.619845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e02a45-7c29-429b-abf0-16e8ceb6b098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.620800 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e02a45-7c29-429b-abf0-16e8ceb6b098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:58.623023 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e02a45-7c29-429b-abf0-16e8ceb6b098 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:58.682917 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c8ac7-2039-4ff2-bd49-8775d0a15c32 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:58.684879 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-823c8ac7-2039-4ff2-bd49-8775d0a15c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:58.697626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c8ac7-2039-4ff2-bd49-8775d0a15c32 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:58.701694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fcbdd-3669-457b-8ba8-4bad8b550e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:58.702474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fcbdd-3669-457b-8ba8-4bad8b550e4e service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.702758 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fcbdd-3669-457b-8ba8-4bad8b550e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.703154 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fcbdd-3669-457b-8ba8-4bad8b550e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.705805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1d5fcbdd-3669-457b-8ba8-4bad8b550e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:58.706505 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1298/2605] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:58 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:32:58.710823 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e02a45-7c29-429b-abf0-16e8ceb6b098 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:58.719836 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fcbdd-3669-457b-8ba8-4bad8b550e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:58.722116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fcbdd-3669-457b-8ba8-4bad8b550e4e service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:58.731592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1308/2606] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:58.782754 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e02a45-7c29-429b-abf0-16e8ceb6b098 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:58.788410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e61e4-0f22-4132-a58d-0ec5c2e80cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:58.789164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e61e4-0f22-4132-a58d-0ec5c2e80cae admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.789452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e61e4-0f22-4132-a58d-0ec5c2e80cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.789730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e61e4-0f22-4132-a58d-0ec5c2e80cae admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.790432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e61e4-0f22-4132-a58d-0ec5c2e80cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:58.792480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e61e4-0f22-4132-a58d-0ec5c2e80cae admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:58.874100 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1299/2607] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:32:58 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:32:58.875335 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fcbdd-3669-457b-8ba8-4bad8b550e4e service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:58.887342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fcbdd-3669-457b-8ba8-4bad8b550e4e service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:58.892130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94a208-56b6-4dec-9762-12619bfa90ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:58.893538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94a208-56b6-4dec-9762-12619bfa90ba admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.893953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94a208-56b6-4dec-9762-12619bfa90ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.898986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94a208-56b6-4dec-9762-12619bfa90ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.898986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94a208-56b6-4dec-9762-12619bfa90ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:58.898986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94a208-56b6-4dec-9762-12619bfa90ba admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:58.910238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1309/2608] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:32:58.912388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e61e4-0f22-4132-a58d-0ec5c2e80cae admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:58.923098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e61e4-0f22-4132-a58d-0ec5c2e80cae admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:58.928763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2499d5c-0744-4af3-8d5c-546ec0b01eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:58.929479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2499d5c-0744-4af3-8d5c-546ec0b01eeb admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.929763 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2499d5c-0744-4af3-8d5c-546ec0b01eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.930037 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2499d5c-0744-4af3-8d5c-546ec0b01eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.931092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2499d5c-0744-4af3-8d5c-546ec0b01eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:58.932344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2499d5c-0744-4af3-8d5c-546ec0b01eeb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:58.943522 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1300/2609] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:32:58.947949 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94a208-56b6-4dec-9762-12619bfa90ba admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:58.959510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94a208-56b6-4dec-9762-12619bfa90ba admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:58.964493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f201bb-db71-4d65-aaab-8e21a8ba950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:58.966933 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f201bb-db71-4d65-aaab-8e21a8ba950e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:58.967227 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f201bb-db71-4d65-aaab-8e21a8ba950e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:58.967515 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f201bb-db71-4d65-aaab-8e21a8ba950e admin admin] PATH_INFO: `/v3/projects/3b1f50cedd3a4da79a0072797d7f2354/users/7c048339fc944c98a61247621d57195c/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:58.984162 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f201bb-db71-4d65-aaab-8e21a8ba950e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1f50cedd3a4da79a0072797d7f2354, user_id=7c048339fc944c98a61247621d57195c, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:58.987317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f201bb-db71-4d65-aaab-8e21a8ba950e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:59.086588 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1310/2610] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:32:58 2022] PUT /identity/v3/projects/3b1f50cedd3a4da79a0072797d7f2354/users/7c048339fc944c98a61247621d57195c/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:32:59.097401 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc0f2b-f2bd-4182-a4d9-8f5f2a022761 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:59.098254 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc0f2b-f2bd-4182-a4d9-8f5f2a022761 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:59.098538 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc0f2b-f2bd-4182-a4d9-8f5f2a022761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:59.126638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-01bc0f2b-f2bd-4182-a4d9-8f5f2a022761 None None] MFA Rules not processed for user `7c048339fc944c98a61247621d57195c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:59.128436 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-01bc0f2b-f2bd-4182-a4d9-8f5f2a022761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:59.204573 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1301/2611] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:59.216301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f201bb-db71-4d65-aaab-8e21a8ba950e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:59.218049 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-24f201bb-db71-4d65-aaab-8e21a8ba950e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:59.256275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc0f2b-f2bd-4182-a4d9-8f5f2a022761 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:59.258748 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-01bc0f2b-f2bd-4182-a4d9-8f5f2a022761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:59.280164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f201bb-db71-4d65-aaab-8e21a8ba950e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:59.284883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a6aca-e511-49ee-8593-60a60727d02f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:59.285618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a6aca-e511-49ee-8593-60a60727d02f service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:59.285904 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a6aca-e511-49ee-8593-60a60727d02f service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:59.286240 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a6aca-e511-49ee-8593-60a60727d02f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:59.299485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a6aca-e511-49ee-8593-60a60727d02f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:59.301653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a6aca-e511-49ee-8593-60a60727d02f service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:59.325090 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1311/2612] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:32:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:32:59.347081 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc0f2b-f2bd-4182-a4d9-8f5f2a022761 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:59.351903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:59.352762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:59.353077 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:59.353352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] PATH_INFO: `/v3/projects/d0311ca0e4784db68b15543d7930ef01` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:59.354580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0311ca0e4784db68b15543d7930ef01)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:59.356461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:59.518951 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0311ca0e4784db68b15543d7930ef01', 'request_id': 'req-28194089-9ff7-429e-9bfa-3557072827ec'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:59.629415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0311ca0e4784db68b15543d7930ef01', 'request_id': 'req-28194089-9ff7-429e-9bfa-3557072827ec'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:59.643771 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0311ca0e4784db68b15543d7930ef01', 'request_id': 'req-28194089-9ff7-429e-9bfa-3557072827ec'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:59.667634 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] The token cache is being invalidate because project d0311ca0e4784db68b15543d7930ef01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:32:59.667881 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:59.668562 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-28194089-9ff7-429e-9bfa-3557072827ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:32:59.670750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1302/2613] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:32:59 2022] DELETE /identity/v3/projects/d0311ca0e4784db68b15543d7930ef01 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:32:59.677196 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44b116-3847-474c-bdee-488e785d4fb2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:59.677853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44b116-3847-474c-bdee-488e785d4fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:59.678219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44b116-3847-474c-bdee-488e785d4fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:59.702506 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4d44b116-3847-474c-bdee-488e785d4fb2 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:59.704807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4d44b116-3847-474c-bdee-488e785d4fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:59.784672 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1312/2614] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:32:59.786877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc88b5b-8cd0-4af3-bac0-1ba6e503865f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:59.787300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc88b5b-8cd0-4af3-bac0-1ba6e503865f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:59.787616 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc88b5b-8cd0-4af3-bac0-1ba6e503865f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:59.815699 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2fc88b5b-8cd0-4af3-bac0-1ba6e503865f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:32:59.815699 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2fc88b5b-8cd0-4af3-bac0-1ba6e503865f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:32:59.816933 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1303/2615] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:32:59.821123 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44b116-3847-474c-bdee-488e785d4fb2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:59.831251 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44b116-3847-474c-bdee-488e785d4fb2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:59.835946 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc8bb3-aab5-4b7b-ada8-4c193c0bb3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:59.836614 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc8bb3-aab5-4b7b-ada8-4c193c0bb3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:59.836883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc8bb3-aab5-4b7b-ada8-4c193c0bb3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:59.837183 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc8bb3-aab5-4b7b-ada8-4c193c0bb3c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:59.837905 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc8bb3-aab5-4b7b-ada8-4c193c0bb3c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:32:59.838212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc8bb3-aab5-4b7b-ada8-4c193c0bb3c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:59.839812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc8bb3-aab5-4b7b-ada8-4c193c0bb3c7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:32:59.852234 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1313/2616] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:32:59.856531 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc88b5b-8cd0-4af3-bac0-1ba6e503865f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:32:59.866855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc88b5b-8cd0-4af3-bac0-1ba6e503865f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:32:59.871495 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8c88c-1da8-4b75-b1c1-211298ca95f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:32:59.872172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8c88c-1da8-4b75-b1c1-211298ca95f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:32:59.872452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8c88c-1da8-4b75-b1c1-211298ca95f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:32:59.872720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8c88c-1da8-4b75-b1c1-211298ca95f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:32:59.873443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8c88c-1da8-4b75-b1c1-211298ca95f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:32:59.875315 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8c88c-1da8-4b75-b1c1-211298ca95f1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:00.038296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1304/2617] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:32:59 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:33:00.040915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc8bb3-aab5-4b7b-ada8-4c193c0bb3c7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:00.057578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc8bb3-aab5-4b7b-ada8-4c193c0bb3c7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:00.135177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f55ce-8cad-41bf-93a0-91d8d4e45e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:00.135771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f55ce-8cad-41bf-93a0-91d8d4e45e7e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:00.136215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f55ce-8cad-41bf-93a0-91d8d4e45e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:00.136496 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f55ce-8cad-41bf-93a0-91d8d4e45e7e admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:00.137266 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f55ce-8cad-41bf-93a0-91d8d4e45e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:00.139238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f55ce-8cad-41bf-93a0-91d8d4e45e7e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:00.265282 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1314/2618] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:33:00 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:33:00.271527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8c88c-1da8-4b75-b1c1-211298ca95f1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:00.282261 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8c88c-1da8-4b75-b1c1-211298ca95f1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:00.291749 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ff3e3-071f-4dc2-9199-78754788cf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:00.292581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ff3e3-071f-4dc2-9199-78754788cf21 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:00.292855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ff3e3-071f-4dc2-9199-78754788cf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:00.293163 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ff3e3-071f-4dc2-9199-78754788cf21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:00.294097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ff3e3-071f-4dc2-9199-78754788cf21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:00.295752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ff3e3-071f-4dc2-9199-78754788cf21 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:00.309087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1305/2619] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:33:00.313254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f55ce-8cad-41bf-93a0-91d8d4e45e7e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:00.327418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f55ce-8cad-41bf-93a0-91d8d4e45e7e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:00.334619 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfac034-7ee1-4051-b4ca-5ecf3d6d2625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:00.335297 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac034-7ee1-4051-b4ca-5ecf3d6d2625 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:00.335584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac034-7ee1-4051-b4ca-5ecf3d6d2625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:00.335859 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac034-7ee1-4051-b4ca-5ecf3d6d2625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:00.336948 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfac034-7ee1-4051-b4ca-5ecf3d6d2625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:00.338607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfac034-7ee1-4051-b4ca-5ecf3d6d2625 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:00.352301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1315/2620] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:33:00.355353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ff3e3-071f-4dc2-9199-78754788cf21 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:00.366101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ff3e3-071f-4dc2-9199-78754788cf21 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:00.370932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676796a-3705-4fd7-ab9c-b592ab8241ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:00.371884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676796a-3705-4fd7-ab9c-b592ab8241ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:00.372226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676796a-3705-4fd7-ab9c-b592ab8241ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:00.372567 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676796a-3705-4fd7-ab9c-b592ab8241ac admin admin] PATH_INFO: `/v3/projects/de870745ee7f4b7a8f088df471bd2a54/users/2139c63193a3480bb8c4fb73be893e96/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:00.388940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676796a-3705-4fd7-ab9c-b592ab8241ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=de870745ee7f4b7a8f088df471bd2a54, user_id=2139c63193a3480bb8c4fb73be893e96, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:00.391745 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676796a-3705-4fd7-ab9c-b592ab8241ac admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:00.522049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1306/2621] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:33:00 2022] PUT /identity/v3/projects/de870745ee7f4b7a8f088df471bd2a54/users/2139c63193a3480bb8c4fb73be893e96/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:33:00.581350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49251-f723-44fd-ad66-8f811b97c7ed None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:00.581798 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49251-f723-44fd-ad66-8f811b97c7ed None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:00.582080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49251-f723-44fd-ad66-8f811b97c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:00.599964 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-09f49251-f723-44fd-ad66-8f811b97c7ed None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:00.601251 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-09f49251-f723-44fd-ad66-8f811b97c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:00.662791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1316/2622] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:00.672759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676796a-3705-4fd7-ab9c-b592ab8241ac admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:00.674829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8676796a-3705-4fd7-ab9c-b592ab8241ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:00.746897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676796a-3705-4fd7-ab9c-b592ab8241ac admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:00.750925 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3d2fc-be65-4014-9d77-2b486c07b936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:00.751636 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3d2fc-be65-4014-9d77-2b486c07b936 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:00.751923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3d2fc-be65-4014-9d77-2b486c07b936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:00.753114 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3d2fc-be65-4014-9d77-2b486c07b936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:00.764117 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3d2fc-be65-4014-9d77-2b486c07b936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:00.765708 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3d2fc-be65-4014-9d77-2b486c07b936 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:00.776814 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1307/2623] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:33:02.165937 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a9266-0f3e-4c00-9d93-3347fb1c35e2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:02.166460 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a9266-0f3e-4c00-9d93-3347fb1c35e2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:02.166546 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a9266-0f3e-4c00-9d93-3347fb1c35e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:02.214353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3c0a9266-0f3e-4c00-9d93-3347fb1c35e2 None None] MFA Rules not processed for user `2139c63193a3480bb8c4fb73be893e96`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:02.216953 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3c0a9266-0f3e-4c00-9d93-3347fb1c35e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:02.314946 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1317/2624] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:02.326376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3d2fc-be65-4014-9d77-2b486c07b936 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:02.327517 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1ca3d2fc-be65-4014-9d77-2b486c07b936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:02.385642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3d2fc-be65-4014-9d77-2b486c07b936 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:02.389268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c108d-9835-4c59-804e-38fac0978c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:02.389925 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c108d-9835-4c59-804e-38fac0978c1f service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:02.395097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c108d-9835-4c59-804e-38fac0978c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:02.395097 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c108d-9835-4c59-804e-38fac0978c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:02.400521 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c108d-9835-4c59-804e-38fac0978c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:02.401978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c108d-9835-4c59-804e-38fac0978c1f service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:02.412161 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1308/2625] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:33:05.400919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82814c-9a94-484c-ae67-a2034e77ac61 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:05.401529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82814c-9a94-484c-ae67-a2034e77ac61 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:05.401817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82814c-9a94-484c-ae67-a2034e77ac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:05.449231 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9b82814c-9a94-484c-ae67-a2034e77ac61 None None] MFA Rules not processed for user `2139c63193a3480bb8c4fb73be893e96`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:05.449986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9b82814c-9a94-484c-ae67-a2034e77ac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:05.464670 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1318/2626] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:05.725978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c108d-9835-4c59-804e-38fac0978c1f service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:05.728315 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-913c108d-9835-4c59-804e-38fac0978c1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:05.740486 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c108d-9835-4c59-804e-38fac0978c1f service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:05.744088 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa51b30-fdcc-4bd2-9301-270cebb011c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:05.744706 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa51b30-fdcc-4bd2-9301-270cebb011c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:05.745019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa51b30-fdcc-4bd2-9301-270cebb011c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:05.745303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa51b30-fdcc-4bd2-9301-270cebb011c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:05.747131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8aa51b30-fdcc-4bd2-9301-270cebb011c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:05.762694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa51b30-fdcc-4bd2-9301-270cebb011c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:05.764284 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa51b30-fdcc-4bd2-9301-270cebb011c6 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:05.776122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1309/2627] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:33:09.563298 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82814c-9a94-484c-ae67-a2034e77ac61 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:09.564954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9b82814c-9a94-484c-ae67-a2034e77ac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:09.589974 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82814c-9a94-484c-ae67-a2034e77ac61 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:09.597780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:09.598765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:09.599080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:09.599594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] PATH_INFO: `/v3/users/7c048339fc944c98a61247621d57195c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:09.601097 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c048339fc944c98a61247621d57195c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:09.603116 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:09.895120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c048339fc944c98a61247621d57195c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:09.909393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c048339fc944c98a61247621d57195c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:09.910423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c048339fc944c98a61247621d57195c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:09.918853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c048339fc944c98a61247621d57195c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:09.919596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c048339fc944c98a61247621d57195c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:10.027999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1319/2628] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:33:09 2022] DELETE /identity/v3/users/7c048339fc944c98a61247621d57195c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:33:10.032352 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea779-b4da-44d0-b858-8d1b56864975 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:10.032896 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea779-b4da-44d0-b858-8d1b56864975 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:10.032896 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea779-b4da-44d0-b858-8d1b56864975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:10.051178 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-061ea779-b4da-44d0-b858-8d1b56864975 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:10.052395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-061ea779-b4da-44d0-b858-8d1b56864975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:10.119273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1310/2629] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:10.132107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:10.133562 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:10.208120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27e112-7630-42c6-b3be-e6fe5add65ba admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:10.212398 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516d25-598b-47b4-b006-00cb958ada64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:10.213024 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516d25-598b-47b4-b006-00cb958ada64 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:10.213372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516d25-598b-47b4-b006-00cb958ada64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:10.213650 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516d25-598b-47b4-b006-00cb958ada64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:10.224341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0516d25-598b-47b4-b006-00cb958ada64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:10.226159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0516d25-598b-47b4-b006-00cb958ada64 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:10.237058 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1320/2630] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:33:10.434227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ea779-b4da-44d0-b858-8d1b56864975 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:10.435829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-061ea779-b4da-44d0-b858-8d1b56864975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:10.450176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ea779-b4da-44d0-b858-8d1b56864975 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:10.456709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46d881-05a7-4370-9300-5d4183ed7788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:10.457653 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d881-05a7-4370-9300-5d4183ed7788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:10.458211 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d881-05a7-4370-9300-5d4183ed7788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:10.458695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d881-05a7-4370-9300-5d4183ed7788 admin admin] PATH_INFO: `/v3/users/6388423ccb4f44a0981a8b994fd222ed` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:10.459991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46d881-05a7-4370-9300-5d4183ed7788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6388423ccb4f44a0981a8b994fd222ed)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:10.461956 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46d881-05a7-4370-9300-5d4183ed7788 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:10.785510 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6d46d881-05a7-4370-9300-5d4183ed7788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6388423ccb4f44a0981a8b994fd222ed'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:10.798285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6d46d881-05a7-4370-9300-5d4183ed7788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6388423ccb4f44a0981a8b994fd222ed'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:10.844345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516d25-598b-47b4-b006-00cb958ada64 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:10.846948 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c0516d25-598b-47b4-b006-00cb958ada64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:10.863273 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516d25-598b-47b4-b006-00cb958ada64 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:10.868333 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:10.869237 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:10.869518 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:10.869793 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] PATH_INFO: `/v3/projects/3b1f50cedd3a4da79a0072797d7f2354` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:10.871114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1f50cedd3a4da79a0072797d7f2354)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:10.873351 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:10.963251 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6d46d881-05a7-4370-9300-5d4183ed7788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6388423ccb4f44a0981a8b994fd222ed'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:10.971558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6d46d881-05a7-4370-9300-5d4183ed7788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6388423ccb4f44a0981a8b994fd222ed'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:10.972363 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6d46d881-05a7-4370-9300-5d4183ed7788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6388423ccb4f44a0981a8b994fd222ed'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:10.978503 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1311/2631] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:33:10 2022] DELETE /identity/v3/users/6388423ccb4f44a0981a8b994fd222ed => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:33:11.118855 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1f50cedd3a4da79a0072797d7f2354', 'request_id': 'req-de7bbe24-ba96-46b6-b78d-e6b9399537aa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:11.184125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1f50cedd3a4da79a0072797d7f2354', 'request_id': 'req-de7bbe24-ba96-46b6-b78d-e6b9399537aa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:11.199903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1f50cedd3a4da79a0072797d7f2354', 'request_id': 'req-de7bbe24-ba96-46b6-b78d-e6b9399537aa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:11.215599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] The token cache is being invalidate because project 3b1f50cedd3a4da79a0072797d7f2354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:33:11.215975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:11.216726 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:11.218482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1321/2632] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:33:10 2022] DELETE /identity/v3/projects/3b1f50cedd3a4da79a0072797d7f2354 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:33:11.225642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62baa1-65a9-4379-9d4b-16e28fd8f51b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.226175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62baa1-65a9-4379-9d4b-16e28fd8f51b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.226651 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62baa1-65a9-4379-9d4b-16e28fd8f51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.249582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5c62baa1-65a9-4379-9d4b-16e28fd8f51b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:11.253728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5c62baa1-65a9-4379-9d4b-16e28fd8f51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:11.262150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:11.263769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:11.326472 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1312/2633] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:11.336101 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cc926-9936-424f-bdd2-135cb8b60d72 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.336394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cc926-9936-424f-bdd2-135cb8b60d72 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.336683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cc926-9936-424f-bdd2-135cb8b60d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.348003 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bbe24-ba96-46b6-b78d-e6b9399537aa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:11.352852 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:11.353908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.354274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.354583 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] PATH_INFO: `/v3/projects/9b35d4f1f2124b17b32c97ef1876ab53` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.355936 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b35d4f1f2124b17b32c97ef1876ab53)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:11.357985 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:11.362798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-454cc926-9936-424f-bdd2-135cb8b60d72 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:11.364261 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-454cc926-9936-424f-bdd2-135cb8b60d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:11.373075 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1313/2634] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:33:11.383108 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cc926-9936-424f-bdd2-135cb8b60d72 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:11.392998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cc926-9936-424f-bdd2-135cb8b60d72 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:11.398018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90899069-68df-433a-878b-18379804be90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:11.398700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90899069-68df-433a-878b-18379804be90 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.398987 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90899069-68df-433a-878b-18379804be90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.399288 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90899069-68df-433a-878b-18379804be90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.400020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90899069-68df-433a-878b-18379804be90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:33:11.400356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90899069-68df-433a-878b-18379804be90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:11.401981 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90899069-68df-433a-878b-18379804be90 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:11.415472 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1314/2635] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:33:11.421192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90899069-68df-433a-878b-18379804be90 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:11.435454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90899069-68df-433a-878b-18379804be90 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:11.442082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddeada-bc89-4647-bd65-d561ef6ff314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:11.442624 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddeada-bc89-4647-bd65-d561ef6ff314 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.442954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddeada-bc89-4647-bd65-d561ef6ff314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.443181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddeada-bc89-4647-bd65-d561ef6ff314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.443909 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddeada-bc89-4647-bd65-d561ef6ff314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:11.445911 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddeada-bc89-4647-bd65-d561ef6ff314 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:11.520685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b35d4f1f2124b17b32c97ef1876ab53', 'request_id': 'req-95e59c78-2578-45d9-9a9a-c9ef9cc34627'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:11.606715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b35d4f1f2124b17b32c97ef1876ab53', 'request_id': 'req-95e59c78-2578-45d9-9a9a-c9ef9cc34627'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:11.619243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1315/2636] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:33:11 2022] POST /identity/v3/projects => generated 369 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:33:11.619425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b35d4f1f2124b17b32c97ef1876ab53', 'request_id': 'req-95e59c78-2578-45d9-9a9a-c9ef9cc34627'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:11.621106 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddeada-bc89-4647-bd65-d561ef6ff314 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:11.632272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] The token cache is being invalidate because project 9b35d4f1f2124b17b32c97ef1876ab53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:33:11.632704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:11.633743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-95e59c78-2578-45d9-9a9a-c9ef9cc34627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:11.636426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1322/2637] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:33:11 2022] DELETE /identity/v3/projects/9b35d4f1f2124b17b32c97ef1876ab53 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:33:11.643226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baae0a-c269-44f6-b253-9680ba986ca2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.643770 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baae0a-c269-44f6-b253-9680ba986ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.644235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baae0a-c269-44f6-b253-9680ba986ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.665894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e0baae0a-c269-44f6-b253-9680ba986ca2 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:11.668055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e0baae0a-c269-44f6-b253-9680ba986ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:11.702493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddeada-bc89-4647-bd65-d561ef6ff314 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:11.709304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78309574-5843-4df6-8c5b-c4ad5adfd3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:11.711266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78309574-5843-4df6-8c5b-c4ad5adfd3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.711733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78309574-5843-4df6-8c5b-c4ad5adfd3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.712014 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78309574-5843-4df6-8c5b-c4ad5adfd3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.712711 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78309574-5843-4df6-8c5b-c4ad5adfd3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:11.714669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78309574-5843-4df6-8c5b-c4ad5adfd3d0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:11.739074 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1323/2638] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:11.747747 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0ac48-7037-45e5-bfdf-f125d8e7de0e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.748032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0ac48-7037-45e5-bfdf-f125d8e7de0e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.752929 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0ac48-7037-45e5-bfdf-f125d8e7de0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.767418 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-65d0ac48-7037-45e5-bfdf-f125d8e7de0e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:11.769044 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-65d0ac48-7037-45e5-bfdf-f125d8e7de0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:11.790762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1324/2639] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:33:11.795192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0ac48-7037-45e5-bfdf-f125d8e7de0e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:11.805544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0ac48-7037-45e5-bfdf-f125d8e7de0e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:11.810771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac2c82-e77d-433c-b267-936ff3096ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:11.811465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac2c82-e77d-433c-b267-936ff3096ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.811733 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac2c82-e77d-433c-b267-936ff3096ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.812029 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac2c82-e77d-433c-b267-936ff3096ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.812738 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac2c82-e77d-433c-b267-936ff3096ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:33:11.813078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac2c82-e77d-433c-b267-936ff3096ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:11.815657 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac2c82-e77d-433c-b267-936ff3096ab4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:11.829149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1325/2640] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:33:11.843174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1316/2641] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:33:11 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:33:11.845810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac2c82-e77d-433c-b267-936ff3096ab4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:11.846343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78309574-5843-4df6-8c5b-c4ad5adfd3d0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:11.849198 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-78309574-5843-4df6-8c5b-c4ad5adfd3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:11.857091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac2c82-e77d-433c-b267-936ff3096ab4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:11.863915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73b782-dff3-4bd8-be6b-7627e174edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:11.864644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73b782-dff3-4bd8-be6b-7627e174edf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.865240 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73b782-dff3-4bd8-be6b-7627e174edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.865679 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73b782-dff3-4bd8-be6b-7627e174edf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.866581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73b782-dff3-4bd8-be6b-7627e174edf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:11.868209 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78309574-5843-4df6-8c5b-c4ad5adfd3d0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:11.868560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73b782-dff3-4bd8-be6b-7627e174edf5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:11.875281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeb3b1-bc71-42f6-8f40-d0119c719203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:11.886301 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb3b1-bc71-42f6-8f40-d0119c719203 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.886690 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb3b1-bc71-42f6-8f40-d0119c719203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.887780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb3b1-bc71-42f6-8f40-d0119c719203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.888082 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaeb3b1-bc71-42f6-8f40-d0119c719203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:11.889862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaeb3b1-bc71-42f6-8f40-d0119c719203 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:11.901384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1317/2642] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:33:11.905406 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeb3b1-bc71-42f6-8f40-d0119c719203 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:11.915737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeb3b1-bc71-42f6-8f40-d0119c719203 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:11.920598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71ca9d-7496-4697-b0fe-6ff4115b5907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:11.921287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ca9d-7496-4697-b0fe-6ff4115b5907 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.921570 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ca9d-7496-4697-b0fe-6ff4115b5907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.921844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ca9d-7496-4697-b0fe-6ff4115b5907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.922565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71ca9d-7496-4697-b0fe-6ff4115b5907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:11.924181 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71ca9d-7496-4697-b0fe-6ff4115b5907 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:11.935150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1318/2643] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:33:11.940890 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71ca9d-7496-4697-b0fe-6ff4115b5907 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:11.950737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71ca9d-7496-4697-b0fe-6ff4115b5907 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:11.956326 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96060f0e-6aa1-4ec4-878f-f142e93ad6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:11.957264 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96060f0e-6aa1-4ec4-878f-f142e93ad6ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:11.957548 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96060f0e-6aa1-4ec4-878f-f142e93ad6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:11.957828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96060f0e-6aa1-4ec4-878f-f142e93ad6ef admin admin] PATH_INFO: `/v3/projects/cc9892191b0846b99183a0b09696ea8f/users/f1bacaec6b7e4a8db732b43fef3aa489/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:11.967944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1326/2644] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:33:11 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:33:11.972372 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73b782-dff3-4bd8-be6b-7627e174edf5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:11.974480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96060f0e-6aa1-4ec4-878f-f142e93ad6ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9892191b0846b99183a0b09696ea8f, user_id=f1bacaec6b7e4a8db732b43fef3aa489, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:11.977874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96060f0e-6aa1-4ec4-878f-f142e93ad6ef admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:12.040254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73b782-dff3-4bd8-be6b-7627e174edf5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:12.045215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64ac87-5f17-4586-b05c-0fa61bd461d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:12.045837 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64ac87-5f17-4586-b05c-0fa61bd461d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:12.046126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64ac87-5f17-4586-b05c-0fa61bd461d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:12.046389 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64ac87-5f17-4586-b05c-0fa61bd461d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:12.047118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64ac87-5f17-4586-b05c-0fa61bd461d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:12.049380 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64ac87-5f17-4586-b05c-0fa61bd461d4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:12.082164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1319/2645] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:33:11 2022] PUT /identity/v3/projects/cc9892191b0846b99183a0b09696ea8f/users/f1bacaec6b7e4a8db732b43fef3aa489/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:33:12.093197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0c6a7-7e1a-48b8-ab03-6dbf6dfd7a0e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:12.093482 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0c6a7-7e1a-48b8-ab03-6dbf6dfd7a0e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:12.093761 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0c6a7-7e1a-48b8-ab03-6dbf6dfd7a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:12.123959 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b0f0c6a7-7e1a-48b8-ab03-6dbf6dfd7a0e None None] MFA Rules not processed for user `f1bacaec6b7e4a8db732b43fef3aa489`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:12.125196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0f0c6a7-7e1a-48b8-ab03-6dbf6dfd7a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:12.172739 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1327/2646] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:33:11 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:33:12.177150 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64ac87-5f17-4586-b05c-0fa61bd461d4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:12.191168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64ac87-5f17-4586-b05c-0fa61bd461d4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:12.197593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1320/2647] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:33:12.210809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0c6a7-7e1a-48b8-ab03-6dbf6dfd7a0e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:12.219931 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0f0c6a7-7e1a-48b8-ab03-6dbf6dfd7a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:12.256906 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956816-ae68-48e4-aa5d-5c2cb64c1c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:12.257610 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956816-ae68-48e4-aa5d-5c2cb64c1c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:12.257891 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956816-ae68-48e4-aa5d-5c2cb64c1c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:12.258164 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956816-ae68-48e4-aa5d-5c2cb64c1c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:12.258890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b956816-ae68-48e4-aa5d-5c2cb64c1c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:12.263380 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b956816-ae68-48e4-aa5d-5c2cb64c1c68 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:12.271432 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1328/2648] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:33:12.275340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956816-ae68-48e4-aa5d-5c2cb64c1c68 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:12.277005 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0c6a7-7e1a-48b8-ab03-6dbf6dfd7a0e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:12.282384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda712cb-46fa-4e56-a9eb-27549c8f355b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef8bbd229c488d97f167c810bc7cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:12.283102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda712cb-46fa-4e56-a9eb-27549c8f355b service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:12.283948 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda712cb-46fa-4e56-a9eb-27549c8f355b service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:12.284232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda712cb-46fa-4e56-a9eb-27549c8f355b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:12.286244 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956816-ae68-48e4-aa5d-5c2cb64c1c68 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:12.290860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26c297-e9a7-4869-8c37-f17192f447b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:12.291563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26c297-e9a7-4869-8c37-f17192f447b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:12.291846 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26c297-e9a7-4869-8c37-f17192f447b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:12.292117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26c297-e9a7-4869-8c37-f17192f447b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:12.292839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26c297-e9a7-4869-8c37-f17192f447b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:12.293806 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda712cb-46fa-4e56-a9eb-27549c8f355b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:12.294474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26c297-e9a7-4869-8c37-f17192f447b0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:12.295239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda712cb-46fa-4e56-a9eb-27549c8f355b service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:12.305017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1329/2649] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:33:12.308982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1321/2650] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:33:12.309119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26c297-e9a7-4869-8c37-f17192f447b0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:12.319288 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26c297-e9a7-4869-8c37-f17192f447b0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:12.332392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b310-fb63-4b3b-a407-78bc739da677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:12.332392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b310-fb63-4b3b-a407-78bc739da677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:12.332392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b310-fb63-4b3b-a407-78bc739da677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:12.332392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b310-fb63-4b3b-a407-78bc739da677 admin admin] PATH_INFO: `/v3/projects/5db8f744906b4260b9dfb77d972dc484/users/f75379cfab784101ab4a5abd506c3270/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:12.344829 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769b310-fb63-4b3b-a407-78bc739da677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db8f744906b4260b9dfb77d972dc484, user_id=f75379cfab784101ab4a5abd506c3270, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:12.349592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769b310-fb63-4b3b-a407-78bc739da677 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:12.516084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1330/2651] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:33:12 2022] PUT /identity/v3/projects/5db8f744906b4260b9dfb77d972dc484/users/f75379cfab784101ab4a5abd506c3270/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:33:12.523145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cfc3f-1e6f-46ae-a08d-2f30717ad65e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:12.523812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cfc3f-1e6f-46ae-a08d-2f30717ad65e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:12.523812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cfc3f-1e6f-46ae-a08d-2f30717ad65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:12.544593 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3a6cfc3f-1e6f-46ae-a08d-2f30717ad65e None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:12.545943 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3a6cfc3f-1e6f-46ae-a08d-2f30717ad65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:12.616335 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1322/2652] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:33:12.627712 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b310-fb63-4b3b-a407-78bc739da677 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:12.629574 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9769b310-fb63-4b3b-a407-78bc739da677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:12.688108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b310-fb63-4b3b-a407-78bc739da677 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:12.692940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9565514-a12e-4d19-80ba-fea693b70a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:12.693626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9565514-a12e-4d19-80ba-fea693b70a0d service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:12.693911 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9565514-a12e-4d19-80ba-fea693b70a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:12.694187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9565514-a12e-4d19-80ba-fea693b70a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:12.704107 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9565514-a12e-4d19-80ba-fea693b70a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:12.710744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9565514-a12e-4d19-80ba-fea693b70a0d service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:12.722015 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1331/2653] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:33:19.099527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e7e9-0872-403c-aeba-c25b85f1ccee None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:19.100448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e7e9-0872-403c-aeba-c25b85f1ccee None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:19.101028 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e7e9-0872-403c-aeba-c25b85f1ccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:19.136047 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5007e7e9-0872-403c-aeba-c25b85f1ccee None None] MFA Rules not processed for user `f75379cfab784101ab4a5abd506c3270`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:19.137281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5007e7e9-0872-403c-aeba-c25b85f1ccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:19.223683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1323/2654] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:19.235245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9565514-a12e-4d19-80ba-fea693b70a0d service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:19.237541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b9565514-a12e-4d19-80ba-fea693b70a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:19.335794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9565514-a12e-4d19-80ba-fea693b70a0d service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:19.344110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c681fd-b79b-45ab-8728-d2e7f97535d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:19.344783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c681fd-b79b-45ab-8728-d2e7f97535d9 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:19.345202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c681fd-b79b-45ab-8728-d2e7f97535d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:19.345505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c681fd-b79b-45ab-8728-d2e7f97535d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:19.355256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c681fd-b79b-45ab-8728-d2e7f97535d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:19.356870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c681fd-b79b-45ab-8728-d2e7f97535d9 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:19.367226 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1332/2655] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:33:23.057586 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac42f-ea89-47d8-b0ff-5ae9dd9c10c9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:23.058043 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac42f-ea89-47d8-b0ff-5ae9dd9c10c9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:23.058253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac42f-ea89-47d8-b0ff-5ae9dd9c10c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:23.082263 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d9aac42f-ea89-47d8-b0ff-5ae9dd9c10c9 None None] MFA Rules not processed for user `f75379cfab784101ab4a5abd506c3270`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:23.083687 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d9aac42f-ea89-47d8-b0ff-5ae9dd9c10c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:23.090938 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1324/2656] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:27.612275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c181c3-26e4-42f6-a2a6-301c8b2163c2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:27.612773 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c181c3-26e4-42f6-a2a6-301c8b2163c2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:27.612872 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c181c3-26e4-42f6-a2a6-301c8b2163c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:27.632824 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-13c181c3-26e4-42f6-a2a6-301c8b2163c2 None None] MFA Rules not processed for user `2139c63193a3480bb8c4fb73be893e96`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:27.634085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-13c181c3-26e4-42f6-a2a6-301c8b2163c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:27.691965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1333/2657] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:41.424565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aac42f-ea89-47d8-b0ff-5ae9dd9c10c9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:41.446317 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aac42f-ea89-47d8-b0ff-5ae9dd9c10c9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:41.456409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:41.458242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:41.458721 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:41.459180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] PATH_INFO: `/v3/users/f1bacaec6b7e4a8db732b43fef3aa489` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:41.461670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1bacaec6b7e4a8db732b43fef3aa489)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:41.463797 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:41.710084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1bacaec6b7e4a8db732b43fef3aa489'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:41.723026 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1bacaec6b7e4a8db732b43fef3aa489'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:41.812040 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1bacaec6b7e4a8db732b43fef3aa489'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:41.822299 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1bacaec6b7e4a8db732b43fef3aa489'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:41.822299 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1bacaec6b7e4a8db732b43fef3aa489'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:41.829902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1325/2658] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:33:41 2022] DELETE /identity/v3/users/f1bacaec6b7e4a8db732b43fef3aa489 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:33:41.834602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463c24a-2a44-49bb-8cff-1ab0fe32935b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:41.835144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463c24a-2a44-49bb-8cff-1ab0fe32935b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:41.835261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463c24a-2a44-49bb-8cff-1ab0fe32935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:41.853893 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1463c24a-2a44-49bb-8cff-1ab0fe32935b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:41.855270 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1463c24a-2a44-49bb-8cff-1ab0fe32935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:41.920609 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1334/2659] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:41.932215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:41.933669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:41.993491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f63ee-c5c4-4a5a-baed-df671e264b8f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:41.996985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4268c29-0792-41c9-a408-09c06876df7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:41.997656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4268c29-0792-41c9-a408-09c06876df7e service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:41.997937 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4268c29-0792-41c9-a408-09c06876df7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:41.998208 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4268c29-0792-41c9-a408-09c06876df7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:42.008062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4268c29-0792-41c9-a408-09c06876df7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:42.009515 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4268c29-0792-41c9-a408-09c06876df7e service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:42.019674 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1326/2660] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:33:42.444787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463c24a-2a44-49bb-8cff-1ab0fe32935b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:42.446292 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1463c24a-2a44-49bb-8cff-1ab0fe32935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:42.458975 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463c24a-2a44-49bb-8cff-1ab0fe32935b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:42.463706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:42.464564 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:42.464849 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:42.465173 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] PATH_INFO: `/v3/projects/cc9892191b0846b99183a0b09696ea8f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:42.466506 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9892191b0846b99183a0b09696ea8f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:42.468407 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:42.601360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9892191b0846b99183a0b09696ea8f', 'request_id': 'req-d6d49abb-2640-48aa-aea2-44549306fb86'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:42.694552 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9892191b0846b99183a0b09696ea8f', 'request_id': 'req-d6d49abb-2640-48aa-aea2-44549306fb86'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:42.701286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9892191b0846b99183a0b09696ea8f', 'request_id': 'req-d6d49abb-2640-48aa-aea2-44549306fb86'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:42.712706 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] The token cache is being invalidate because project cc9892191b0846b99183a0b09696ea8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:33:42.713022 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:42.713680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d6d49abb-2640-48aa-aea2-44549306fb86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:42.715229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1335/2661] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:33:42 2022] DELETE /identity/v3/projects/cc9892191b0846b99183a0b09696ea8f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:33:42.720838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe86c64-76cb-48d4-83e7-5d9dbffc52c8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:42.721378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe86c64-76cb-48d4-83e7-5d9dbffc52c8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:42.721464 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe86c64-76cb-48d4-83e7-5d9dbffc52c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:42.740344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-dfe86c64-76cb-48d4-83e7-5d9dbffc52c8 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:42.742322 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dfe86c64-76cb-48d4-83e7-5d9dbffc52c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:42.801200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1327/2662] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:42.809625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e609405-b6b4-4c56-9991-a020b2752ce5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:42.809912 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e609405-b6b4-4c56-9991-a020b2752ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:42.810187 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e609405-b6b4-4c56-9991-a020b2752ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:42.830498 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8e609405-b6b4-4c56-9991-a020b2752ce5 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:42.832286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8e609405-b6b4-4c56-9991-a020b2752ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:42.840814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1336/2663] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:42.845529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe86c64-76cb-48d4-83e7-5d9dbffc52c8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:42.855053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe86c64-76cb-48d4-83e7-5d9dbffc52c8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:42.859463 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36654d3-4c68-4200-8dfe-15b7f1f25aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:42.860662 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36654d3-4c68-4200-8dfe-15b7f1f25aba admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:42.860947 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36654d3-4c68-4200-8dfe-15b7f1f25aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:42.861446 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36654d3-4c68-4200-8dfe-15b7f1f25aba admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:42.862180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36654d3-4c68-4200-8dfe-15b7f1f25aba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:33:42.862490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36654d3-4c68-4200-8dfe-15b7f1f25aba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:42.864079 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36654d3-4c68-4200-8dfe-15b7f1f25aba admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:42.876668 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1328/2664] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:33:42.880994 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e609405-b6b4-4c56-9991-a020b2752ce5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:42.890045 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e609405-b6b4-4c56-9991-a020b2752ce5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:42.894965 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3dd5e-d721-4899-9547-316c08030710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:42.895605 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3dd5e-d721-4899-9547-316c08030710 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:42.895884 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3dd5e-d721-4899-9547-316c08030710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:42.896153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3dd5e-d721-4899-9547-316c08030710 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:42.896862 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3dd5e-d721-4899-9547-316c08030710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:42.898774 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3dd5e-d721-4899-9547-316c08030710 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:42.979076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1337/2665] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:33:42 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:33:42.983249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36654d3-4c68-4200-8dfe-15b7f1f25aba admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:42.994119 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36654d3-4c68-4200-8dfe-15b7f1f25aba admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:43.050422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320a5bc-4199-4679-bfa0-b1a060a1bfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:43.051098 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a5bc-4199-4679-bfa0-b1a060a1bfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:43.051384 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a5bc-4199-4679-bfa0-b1a060a1bfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:43.051664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a5bc-4199-4679-bfa0-b1a060a1bfd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:43.052356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320a5bc-4199-4679-bfa0-b1a060a1bfd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:43.054300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320a5bc-4199-4679-bfa0-b1a060a1bfd6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:43.132863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1329/2666] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:33:42 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:33:43.137061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3dd5e-d721-4899-9547-316c08030710 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:43.148235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3dd5e-d721-4899-9547-316c08030710 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:43.153105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a86807-c78d-4e39-a0ed-d3a8564e728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:43.153770 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a86807-c78d-4e39-a0ed-d3a8564e728f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:43.154051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a86807-c78d-4e39-a0ed-d3a8564e728f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:43.154323 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a86807-c78d-4e39-a0ed-d3a8564e728f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:43.155040 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a86807-c78d-4e39-a0ed-d3a8564e728f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:43.156701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a86807-c78d-4e39-a0ed-d3a8564e728f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:43.167767 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1338/2667] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:33:43.171936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320a5bc-4199-4679-bfa0-b1a060a1bfd6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:43.182815 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320a5bc-4199-4679-bfa0-b1a060a1bfd6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:43.187547 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc400e-f61b-426d-b81f-917f4adc6eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:43.188258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc400e-f61b-426d-b81f-917f4adc6eed admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:43.188609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc400e-f61b-426d-b81f-917f4adc6eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:43.188876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc400e-f61b-426d-b81f-917f4adc6eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:43.189626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc400e-f61b-426d-b81f-917f4adc6eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:43.191247 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc400e-f61b-426d-b81f-917f4adc6eed admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:43.201407 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1330/2668] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:33:43.206042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a86807-c78d-4e39-a0ed-d3a8564e728f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:43.215772 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a86807-c78d-4e39-a0ed-d3a8564e728f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:43.220899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7a1c4-e38e-4592-8f8a-67abea385d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:43.221806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7a1c4-e38e-4592-8f8a-67abea385d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:43.222091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7a1c4-e38e-4592-8f8a-67abea385d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:43.222365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7a1c4-e38e-4592-8f8a-67abea385d6d admin admin] PATH_INFO: `/v3/projects/a22dd39c29ac4e09a1fc6bdc766bdc43/users/48e5849c5d864ecea7118e8fb1c7b929/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:43.237880 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7a1c4-e38e-4592-8f8a-67abea385d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22dd39c29ac4e09a1fc6bdc766bdc43, user_id=48e5849c5d864ecea7118e8fb1c7b929, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:43.240524 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7a1c4-e38e-4592-8f8a-67abea385d6d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:43.371865 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1339/2669] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:33:43 2022] PUT /identity/v3/projects/a22dd39c29ac4e09a1fc6bdc766bdc43/users/48e5849c5d864ecea7118e8fb1c7b929/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:33:43.382677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ae2b1-0ed9-4372-b0d6-6eab7903644d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:43.383020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ae2b1-0ed9-4372-b0d6-6eab7903644d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:43.383252 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ae2b1-0ed9-4372-b0d6-6eab7903644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:43.411972 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-513ae2b1-0ed9-4372-b0d6-6eab7903644d None None] MFA Rules not processed for user `48e5849c5d864ecea7118e8fb1c7b929`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:43.413227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-513ae2b1-0ed9-4372-b0d6-6eab7903644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:43.476857 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1331/2670] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:43.488262 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7a1c4-e38e-4592-8f8a-67abea385d6d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:43.489946 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8eb7a1c4-e38e-4592-8f8a-67abea385d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:43.547934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7a1c4-e38e-4592-8f8a-67abea385d6d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:43.551661 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03afa4e-0cf7-4593-bb2e-9a365129df09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:43.552309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03afa4e-0cf7-4593-bb2e-9a365129df09 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:43.552591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03afa4e-0cf7-4593-bb2e-9a365129df09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:43.552866 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03afa4e-0cf7-4593-bb2e-9a365129df09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:43.561570 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03afa4e-0cf7-4593-bb2e-9a365129df09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:43.562995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03afa4e-0cf7-4593-bb2e-9a365129df09 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:43.572013 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1340/2671] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:33:43.704132 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ae2b1-0ed9-4372-b0d6-6eab7903644d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:43.705878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-513ae2b1-0ed9-4372-b0d6-6eab7903644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:43.776493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ae2b1-0ed9-4372-b0d6-6eab7903644d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:43.782430 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3152-96fb-4db1-a9c4-6574f8a0d7a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7095f3ab8545c589d4d28a846ba1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:43.783142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3152-96fb-4db1-a9c4-6574f8a0d7a9 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:43.783428 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3152-96fb-4db1-a9c4-6574f8a0d7a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:43.783710 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3152-96fb-4db1-a9c4-6574f8a0d7a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:43.785587 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-41fd3152-96fb-4db1-a9c4-6574f8a0d7a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:43.799238 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd3152-96fb-4db1-a9c4-6574f8a0d7a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:43.800858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd3152-96fb-4db1-a9c4-6574f8a0d7a9 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:43.811755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1332/2672] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:33:54.018084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0d07a-84c6-4143-b46f-d88e677280d8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:54.018704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0d07a-84c6-4143-b46f-d88e677280d8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:54.018704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0d07a-84c6-4143-b46f-d88e677280d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:54.035899 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ffe0d07a-84c6-4143-b46f-d88e677280d8 None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:54.037124 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ffe0d07a-84c6-4143-b46f-d88e677280d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:54.090843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1341/2673] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:33:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:54.292196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3152-96fb-4db1-a9c4-6574f8a0d7a9 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:54.293722 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-41fd3152-96fb-4db1-a9c4-6574f8a0d7a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:54.362041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3152-96fb-4db1-a9c4-6574f8a0d7a9 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:54.367071 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e343bc1-a4ed-413f-aaca-85de0d32c76b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:54.367716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e343bc1-a4ed-413f-aaca-85de0d32c76b service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:54.368004 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e343bc1-a4ed-413f-aaca-85de0d32c76b service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:54.368285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e343bc1-a4ed-413f-aaca-85de0d32c76b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:54.376196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e343bc1-a4ed-413f-aaca-85de0d32c76b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:54.377784 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e343bc1-a4ed-413f-aaca-85de0d32c76b service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:54.385672 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1333/2674] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:33:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:33:57.069374 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0d07a-84c6-4143-b46f-d88e677280d8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:57.140423 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0d07a-84c6-4143-b46f-d88e677280d8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:57.145807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:57.146684 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:57.146964 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:57.147237 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] PATH_INFO: `/v3/users/48e5849c5d864ecea7118e8fb1c7b929` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:57.148428 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e5849c5d864ecea7118e8fb1c7b929)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:57.150425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:57.402727 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e5849c5d864ecea7118e8fb1c7b929'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:57.415813 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e5849c5d864ecea7118e8fb1c7b929'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:57.416852 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e5849c5d864ecea7118e8fb1c7b929'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:57.425641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e5849c5d864ecea7118e8fb1c7b929'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:57.426547 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e5849c5d864ecea7118e8fb1c7b929'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:57.506601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1342/2675] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:33:57 2022] DELETE /identity/v3/users/48e5849c5d864ecea7118e8fb1c7b929 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:33:57.512189 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c591de-9bcb-4ec2-bffb-084392e67389 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:57.512818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c591de-9bcb-4ec2-bffb-084392e67389 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:57.513166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c591de-9bcb-4ec2-bffb-084392e67389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:57.533091 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-25c591de-9bcb-4ec2-bffb-084392e67389 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:57.534730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-25c591de-9bcb-4ec2-bffb-084392e67389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:57.606153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1334/2676] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:57.616119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:57.618081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:57.691343 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce14cc0-5c1c-42ff-9331-3ed0e10bd4aa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:57.695765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77797937-5153-4431-97a1-ac6177397f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:57.696544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77797937-5153-4431-97a1-ac6177397f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:57.697066 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77797937-5153-4431-97a1-ac6177397f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:57.697464 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77797937-5153-4431-97a1-ac6177397f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:57.709663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77797937-5153-4431-97a1-ac6177397f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:57.711260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77797937-5153-4431-97a1-ac6177397f92 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:57.724955 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1343/2677] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:33:58.232324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c591de-9bcb-4ec2-bffb-084392e67389 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:58.233493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-25c591de-9bcb-4ec2-bffb-084392e67389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:58.265267 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c591de-9bcb-4ec2-bffb-084392e67389 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:58.270203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:58.273095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:58.273095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:58.273095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] PATH_INFO: `/v3/projects/a22dd39c29ac4e09a1fc6bdc766bdc43` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:58.273696 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22dd39c29ac4e09a1fc6bdc766bdc43)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:58.276470 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:58.398261 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22dd39c29ac4e09a1fc6bdc766bdc43', 'request_id': 'req-e1b11246-26f5-48bc-b6d3-1239c606393d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:58.465966 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22dd39c29ac4e09a1fc6bdc766bdc43', 'request_id': 'req-e1b11246-26f5-48bc-b6d3-1239c606393d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:58.478867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22dd39c29ac4e09a1fc6bdc766bdc43', 'request_id': 'req-e1b11246-26f5-48bc-b6d3-1239c606393d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:58.501844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] The token cache is being invalidate because project a22dd39c29ac4e09a1fc6bdc766bdc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:33:58.502585 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:58.503568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1b11246-26f5-48bc-b6d3-1239c606393d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:33:58.508856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1335/2678] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:33:58 2022] DELETE /identity/v3/projects/a22dd39c29ac4e09a1fc6bdc766bdc43 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:33:58.510520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76402099-90c0-4d54-a528-340f9fe5a16a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:58.511034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76402099-90c0-4d54-a528-340f9fe5a16a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:58.511149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76402099-90c0-4d54-a528-340f9fe5a16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:58.535761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-76402099-90c0-4d54-a528-340f9fe5a16a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:58.537089 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-76402099-90c0-4d54-a528-340f9fe5a16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:58.611056 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1344/2679] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:58.620461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ce52-e9ed-41db-aeca-0a3b08a7c516 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:58.621027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ce52-e9ed-41db-aeca-0a3b08a7c516 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:58.621290 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ce52-e9ed-41db-aeca-0a3b08a7c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:58.646932 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4603ce52-e9ed-41db-aeca-0a3b08a7c516 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:58.648304 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4603ce52-e9ed-41db-aeca-0a3b08a7c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:58.660862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1336/2680] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:33:58.662146 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76402099-90c0-4d54-a528-340f9fe5a16a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:58.678369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76402099-90c0-4d54-a528-340f9fe5a16a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:58.684019 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9866b-53ec-4a17-8aa7-a7d42e8d2197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:58.684779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9866b-53ec-4a17-8aa7-a7d42e8d2197 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:58.685188 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9866b-53ec-4a17-8aa7-a7d42e8d2197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:58.685426 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9866b-53ec-4a17-8aa7-a7d42e8d2197 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:58.686175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9866b-53ec-4a17-8aa7-a7d42e8d2197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:33:58.686707 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9866b-53ec-4a17-8aa7-a7d42e8d2197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:58.688820 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9866b-53ec-4a17-8aa7-a7d42e8d2197 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:58.702169 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1345/2681] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:33:58.707510 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ce52-e9ed-41db-aeca-0a3b08a7c516 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:58.717553 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ce52-e9ed-41db-aeca-0a3b08a7c516 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:58.723576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44740610-af49-4297-9582-01f07c9ba18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:58.724244 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44740610-af49-4297-9582-01f07c9ba18a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:58.724539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44740610-af49-4297-9582-01f07c9ba18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:58.724798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44740610-af49-4297-9582-01f07c9ba18a admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:58.725632 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44740610-af49-4297-9582-01f07c9ba18a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:58.727442 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44740610-af49-4297-9582-01f07c9ba18a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:58.832265 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1337/2682] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:33:58 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:33:58.833805 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9866b-53ec-4a17-8aa7-a7d42e8d2197 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:58.847377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9866b-53ec-4a17-8aa7-a7d42e8d2197 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:58.920128 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58b19a-cf82-4bb8-be14-f4c306b5a16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:58.921020 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58b19a-cf82-4bb8-be14-f4c306b5a16d admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:58.921384 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58b19a-cf82-4bb8-be14-f4c306b5a16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:58.921738 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58b19a-cf82-4bb8-be14-f4c306b5a16d admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:58.923391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58b19a-cf82-4bb8-be14-f4c306b5a16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:58.928569 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58b19a-cf82-4bb8-be14-f4c306b5a16d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:59.054448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44740610-af49-4297-9582-01f07c9ba18a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:59.061485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1346/2683] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:33:58 2022] POST /identity/v3/users => generated 295 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:33:59.066907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44740610-af49-4297-9582-01f07c9ba18a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:59.073192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97751092-a332-4b12-8e1e-94b478ea7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:59.073912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97751092-a332-4b12-8e1e-94b478ea7581 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:59.074166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97751092-a332-4b12-8e1e-94b478ea7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:59.074494 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97751092-a332-4b12-8e1e-94b478ea7581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:59.075774 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97751092-a332-4b12-8e1e-94b478ea7581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:59.077703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97751092-a332-4b12-8e1e-94b478ea7581 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:59.093488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1338/2684] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:33:59.095072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58b19a-cf82-4bb8-be14-f4c306b5a16d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:59.106179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58b19a-cf82-4bb8-be14-f4c306b5a16d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:59.113428 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbf7ed-3b67-4b99-ac03-ae086a7ee841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:59.116284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbf7ed-3b67-4b99-ac03-ae086a7ee841 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:59.116651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbf7ed-3b67-4b99-ac03-ae086a7ee841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:59.117266 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbf7ed-3b67-4b99-ac03-ae086a7ee841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:59.118683 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbf7ed-3b67-4b99-ac03-ae086a7ee841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:59.121133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbf7ed-3b67-4b99-ac03-ae086a7ee841 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:59.140085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1347/2685] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:33:59.142250 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97751092-a332-4b12-8e1e-94b478ea7581 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:59.153362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97751092-a332-4b12-8e1e-94b478ea7581 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:59.159150 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100303f-fa17-47c6-8519-82612a8fc6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:59.160317 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100303f-fa17-47c6-8519-82612a8fc6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:59.160715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100303f-fa17-47c6-8519-82612a8fc6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:59.161149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100303f-fa17-47c6-8519-82612a8fc6dd admin admin] PATH_INFO: `/v3/projects/1e709df2ce424d4ba4ad63497ca565ef/users/a1385f7d6114485d8ab6273cde707284/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:59.177747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100303f-fa17-47c6-8519-82612a8fc6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e709df2ce424d4ba4ad63497ca565ef, user_id=a1385f7d6114485d8ab6273cde707284, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:59.180559 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100303f-fa17-47c6-8519-82612a8fc6dd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:59.264782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1339/2686] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:33:59 2022] PUT /identity/v3/projects/1e709df2ce424d4ba4ad63497ca565ef/users/a1385f7d6114485d8ab6273cde707284/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:33:59.276085 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b539-eb76-44eb-ad01-5a764686068e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:59.276381 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b539-eb76-44eb-ad01-5a764686068e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:59.276660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b539-eb76-44eb-ad01-5a764686068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:59.307284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6981b539-eb76-44eb-ad01-5a764686068e None None] MFA Rules not processed for user `a1385f7d6114485d8ab6273cde707284`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:33:59.308519 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6981b539-eb76-44eb-ad01-5a764686068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:59.383637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1348/2687] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:33:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:33:59.394848 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100303f-fa17-47c6-8519-82612a8fc6dd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:33:59.396646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5100303f-fa17-47c6-8519-82612a8fc6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:33:59.461620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100303f-fa17-47c6-8519-82612a8fc6dd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:33:59.465881 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a9d1f-d6e8-4351-b3ad-2bb4d177394f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:33:59.466808 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9d1f-d6e8-4351-b3ad-2bb4d177394f service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:33:59.467423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9d1f-d6e8-4351-b3ad-2bb4d177394f service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:33:59.467865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9d1f-d6e8-4351-b3ad-2bb4d177394f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:33:59.478282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a9d1f-d6e8-4351-b3ad-2bb4d177394f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:33:59.479714 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a9d1f-d6e8-4351-b3ad-2bb4d177394f service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:33:59.489964 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1340/2688] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:33:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:34:11.749629 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba73d7-91e5-47b1-bab5-b5fb0c0346dd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:11.750779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba73d7-91e5-47b1-bab5-b5fb0c0346dd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:11.750779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba73d7-91e5-47b1-bab5-b5fb0c0346dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:11.768300 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-daba73d7-91e5-47b1-bab5-b5fb0c0346dd None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:34:11.769596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-daba73d7-91e5-47b1-bab5-b5fb0c0346dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:11.830099 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1349/2689] 10.222.0.61 () {58 vars in 967 bytes} [Tue Apr 12 14:34:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:34:11.842917 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a9d1f-d6e8-4351-b3ad-2bb4d177394f service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:11.844656 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7a7a9d1f-d6e8-4351-b3ad-2bb4d177394f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:11.917301 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a9d1f-d6e8-4351-b3ad-2bb4d177394f service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:11.922893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158bdf1-2cd9-457f-946c-a206d9fbb02f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:11.923465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158bdf1-2cd9-457f-946c-a206d9fbb02f service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:11.923749 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158bdf1-2cd9-457f-946c-a206d9fbb02f service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:11.924021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158bdf1-2cd9-457f-946c-a206d9fbb02f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:11.931903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158bdf1-2cd9-457f-946c-a206d9fbb02f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:11.933493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158bdf1-2cd9-457f-946c-a206d9fbb02f service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:11.941441 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1341/2690] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:34:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:34:16.278180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba73d7-91e5-47b1-bab5-b5fb0c0346dd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:16.281195 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-daba73d7-91e5-47b1-bab5-b5fb0c0346dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:16.361664 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba73d7-91e5-47b1-bab5-b5fb0c0346dd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:16.366127 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:16.366987 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:16.367256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:16.367520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] PATH_INFO: `/v3/users/2139c63193a3480bb8c4fb73be893e96` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:16.368730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2139c63193a3480bb8c4fb73be893e96)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:16.370674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:16.661033 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2139c63193a3480bb8c4fb73be893e96'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:16.673750 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2139c63193a3480bb8c4fb73be893e96'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:16.674622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2139c63193a3480bb8c4fb73be893e96'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:16.681409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2139c63193a3480bb8c4fb73be893e96'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:16.682091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2139c63193a3480bb8c4fb73be893e96'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:16.800350 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1350/2691] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:34:16 2022] DELETE /identity/v3/users/2139c63193a3480bb8c4fb73be893e96 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:34:17.106955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158bdf1-2cd9-457f-946c-a206d9fbb02f service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:17.118867 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158bdf1-2cd9-457f-946c-a206d9fbb02f service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:17.175393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:17.176166 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:17.176445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:17.176715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] PATH_INFO: `/v3/projects/de870745ee7f4b7a8f088df471bd2a54` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:17.177922 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de870745ee7f4b7a8f088df471bd2a54)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:17.179809 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:17.314913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de870745ee7f4b7a8f088df471bd2a54', 'request_id': 'req-dfb73e96-9c13-4b6b-baf7-3d983644b24d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:17.396630 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de870745ee7f4b7a8f088df471bd2a54', 'request_id': 'req-dfb73e96-9c13-4b6b-baf7-3d983644b24d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:17.403525 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de870745ee7f4b7a8f088df471bd2a54', 'request_id': 'req-dfb73e96-9c13-4b6b-baf7-3d983644b24d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:17.414122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] The token cache is being invalidate because project de870745ee7f4b7a8f088df471bd2a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:34:17.414409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:17.415062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dfb73e96-9c13-4b6b-baf7-3d983644b24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:17.416646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1342/2692] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:34:17 2022] DELETE /identity/v3/projects/de870745ee7f4b7a8f088df471bd2a54 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:34:21.215675 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:21.217118 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:21.229928 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6d5c-8690-43c4-b091-f3002ec681b5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:21.285451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:21.286309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:21.286585 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:21.286853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] PATH_INFO: `/v3/users/a1385f7d6114485d8ab6273cde707284` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:21.288011 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1385f7d6114485d8ab6273cde707284)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:21.289952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:21.554530 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1385f7d6114485d8ab6273cde707284'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:21.567560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1385f7d6114485d8ab6273cde707284'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:21.568290 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1385f7d6114485d8ab6273cde707284'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:21.575229 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1385f7d6114485d8ab6273cde707284'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:21.576652 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1385f7d6114485d8ab6273cde707284'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:21.677337 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1351/2693] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:34:21 2022] DELETE /identity/v3/users/a1385f7d6114485d8ab6273cde707284 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:34:21.681939 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487f0d8-ad2f-4ea5-b286-e80c26c07606 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:21.682389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487f0d8-ad2f-4ea5-b286-e80c26c07606 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:21.682485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487f0d8-ad2f-4ea5-b286-e80c26c07606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:21.702543 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1487f0d8-ad2f-4ea5-b286-e80c26c07606 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:34:21.704355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1487f0d8-ad2f-4ea5-b286-e80c26c07606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:21.761746 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1343/2694] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:34:21.771491 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:21.772907 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:21.830284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3c6d1-fc21-44a9-8e3c-dcafc24b6390 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:21.833952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adf4c1-a7a3-4931-a0d1-42415adf06c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:21.834612 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adf4c1-a7a3-4931-a0d1-42415adf06c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:21.834890 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adf4c1-a7a3-4931-a0d1-42415adf06c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:21.835725 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adf4c1-a7a3-4931-a0d1-42415adf06c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:21.845572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adf4c1-a7a3-4931-a0d1-42415adf06c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:21.847078 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adf4c1-a7a3-4931-a0d1-42415adf06c2 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:21.856509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1352/2695] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:34:22.324679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487f0d8-ad2f-4ea5-b286-e80c26c07606 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:22.329558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1487f0d8-ad2f-4ea5-b286-e80c26c07606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:22.345227 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487f0d8-ad2f-4ea5-b286-e80c26c07606 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:22.358893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:22.358893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:22.358893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:22.358893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] PATH_INFO: `/v3/projects/1e709df2ce424d4ba4ad63497ca565ef` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:22.359779 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e709df2ce424d4ba4ad63497ca565ef)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:22.359779 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:22.519476 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e709df2ce424d4ba4ad63497ca565ef', 'request_id': 'req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:22.643785 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e709df2ce424d4ba4ad63497ca565ef', 'request_id': 'req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:22.650770 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e709df2ce424d4ba4ad63497ca565ef', 'request_id': 'req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:22.663382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] The token cache is being invalidate because project 1e709df2ce424d4ba4ad63497ca565ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:34:22.663671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:22.664330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a22e9-6d12-4dd8-a9e9-e1ae7c532142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:34:22.665943 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1344/2696] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:34:22 2022] DELETE /identity/v3/projects/1e709df2ce424d4ba4ad63497ca565ef => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:34:22.671149 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f353d38-ae51-4ee5-900d-4510135e519a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:22.671834 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f353d38-ae51-4ee5-900d-4510135e519a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:22.672120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f353d38-ae51-4ee5-900d-4510135e519a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:22.694256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0f353d38-ae51-4ee5-900d-4510135e519a None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:34:22.695475 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0f353d38-ae51-4ee5-900d-4510135e519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:22.774133 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1353/2697] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:34:22.782448 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af33d46-2b61-409b-a7e3-377c4087c48b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:22.782990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af33d46-2b61-409b-a7e3-377c4087c48b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:22.783126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af33d46-2b61-409b-a7e3-377c4087c48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:22.802087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9af33d46-2b61-409b-a7e3-377c4087c48b None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:34:22.803359 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9af33d46-2b61-409b-a7e3-377c4087c48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:22.811903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1345/2698] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:34:22.817665 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f353d38-ae51-4ee5-900d-4510135e519a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:22.831017 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f353d38-ae51-4ee5-900d-4510135e519a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:22.839386 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd765945-6477-43c5-a69a-b1d5f17ec47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:22.840916 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd765945-6477-43c5-a69a-b1d5f17ec47a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:22.841230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd765945-6477-43c5-a69a-b1d5f17ec47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:22.841508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd765945-6477-43c5-a69a-b1d5f17ec47a admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:22.842247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd765945-6477-43c5-a69a-b1d5f17ec47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:34:22.842560 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd765945-6477-43c5-a69a-b1d5f17ec47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:22.844192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd765945-6477-43c5-a69a-b1d5f17ec47a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:22.859344 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1354/2699] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:34:22.864861 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af33d46-2b61-409b-a7e3-377c4087c48b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:22.874750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af33d46-2b61-409b-a7e3-377c4087c48b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:22.880433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f1a40-7969-4ea9-ba1c-513bfbbc1dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:22.881559 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f1a40-7969-4ea9-ba1c-513bfbbc1dbd admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:22.882014 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f1a40-7969-4ea9-ba1c-513bfbbc1dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:22.882458 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f1a40-7969-4ea9-ba1c-513bfbbc1dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:22.883598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f1a40-7969-4ea9-ba1c-513bfbbc1dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:22.887147 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f1a40-7969-4ea9-ba1c-513bfbbc1dbd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:23.005574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1346/2700] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:34:22 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:34:23.009889 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd765945-6477-43c5-a69a-b1d5f17ec47a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:23.020054 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd765945-6477-43c5-a69a-b1d5f17ec47a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:23.079693 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bc2f5-39a3-48d8-9f8b-18a8c5e203a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:23.080349 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc2f5-39a3-48d8-9f8b-18a8c5e203a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:23.080635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc2f5-39a3-48d8-9f8b-18a8c5e203a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:23.080914 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc2f5-39a3-48d8-9f8b-18a8c5e203a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:23.081663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bc2f5-39a3-48d8-9f8b-18a8c5e203a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:23.083595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bc2f5-39a3-48d8-9f8b-18a8c5e203a1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:23.231650 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1355/2701] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:34:23 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:34:23.237232 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f1a40-7969-4ea9-ba1c-513bfbbc1dbd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:23.247849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f1a40-7969-4ea9-ba1c-513bfbbc1dbd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:23.252724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18794769-7ce3-4e23-9749-3390292ce506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:23.253435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18794769-7ce3-4e23-9749-3390292ce506 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:23.253723 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18794769-7ce3-4e23-9749-3390292ce506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:23.253997 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18794769-7ce3-4e23-9749-3390292ce506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:23.254757 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18794769-7ce3-4e23-9749-3390292ce506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:23.256354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18794769-7ce3-4e23-9749-3390292ce506 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:23.267103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1347/2702] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:34:23.271108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bc2f5-39a3-48d8-9f8b-18a8c5e203a1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:23.282084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bc2f5-39a3-48d8-9f8b-18a8c5e203a1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:23.286993 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91fe33-c00b-4298-98d7-b8f19998c54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:23.287656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fe33-c00b-4298-98d7-b8f19998c54a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:23.287944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fe33-c00b-4298-98d7-b8f19998c54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:23.288225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fe33-c00b-4298-98d7-b8f19998c54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:23.288951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91fe33-c00b-4298-98d7-b8f19998c54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:23.290586 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91fe33-c00b-4298-98d7-b8f19998c54a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:23.302505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1356/2703] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:34:23.306761 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18794769-7ce3-4e23-9749-3390292ce506 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:23.317125 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18794769-7ce3-4e23-9749-3390292ce506 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:23.321650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280683a5-fe33-4c6a-a147-adb281366b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:23.322531 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280683a5-fe33-4c6a-a147-adb281366b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:23.322814 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280683a5-fe33-4c6a-a147-adb281366b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:23.323087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280683a5-fe33-4c6a-a147-adb281366b1d admin admin] PATH_INFO: `/v3/projects/4a2b25630afa4793a520fafc47c2c2ff/users/9eb428022c154a529225e7d390318e82/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:23.338134 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280683a5-fe33-4c6a-a147-adb281366b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a2b25630afa4793a520fafc47c2c2ff, user_id=9eb428022c154a529225e7d390318e82, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:23.340678 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280683a5-fe33-4c6a-a147-adb281366b1d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:23.454944 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1348/2704] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:34:23 2022] PUT /identity/v3/projects/4a2b25630afa4793a520fafc47c2c2ff/users/9eb428022c154a529225e7d390318e82/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:34:23.460040 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc1634-bff1-4859-9159-f05215b801a5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:23.460329 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc1634-bff1-4859-9159-f05215b801a5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:23.460608 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc1634-bff1-4859-9159-f05215b801a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:23.478530 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c7fc1634-bff1-4859-9159-f05215b801a5 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:34:23.479744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c7fc1634-bff1-4859-9159-f05215b801a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:23.538120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1357/2705] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:34:23.548528 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280683a5-fe33-4c6a-a147-adb281366b1d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:23.550273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-280683a5-fe33-4c6a-a147-adb281366b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:23.607570 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280683a5-fe33-4c6a-a147-adb281366b1d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:23.611223 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddfd4c-8f4a-4be9-b7f1-469f8272f5d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:23.611864 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddfd4c-8f4a-4be9-b7f1-469f8272f5d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:23.612149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddfd4c-8f4a-4be9-b7f1-469f8272f5d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:23.612425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddfd4c-8f4a-4be9-b7f1-469f8272f5d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:23.621907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddfd4c-8f4a-4be9-b7f1-469f8272f5d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:23.623370 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddfd4c-8f4a-4be9-b7f1-469f8272f5d1 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:23.633170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1349/2706] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:34:29.369179 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feaad7-0c88-4128-b57d-0b3fecd39de9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:29.369699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feaad7-0c88-4128-b57d-0b3fecd39de9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:29.369817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feaad7-0c88-4128-b57d-0b3fecd39de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:29.399714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-04feaad7-0c88-4128-b57d-0b3fecd39de9 None None] MFA Rules not processed for user `9eb428022c154a529225e7d390318e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:34:29.400989 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-04feaad7-0c88-4128-b57d-0b3fecd39de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:29.488829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddfd4c-8f4a-4be9-b7f1-469f8272f5d1 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:29.489635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1358/2707] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:34:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:34:29.493149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddfd4c-8f4a-4be9-b7f1-469f8272f5d1 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:29.498391 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc9f5a-75c0-4751-ad54-095c9eb49e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:29.499092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc9f5a-75c0-4751-ad54-095c9eb49e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:29.499370 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc9f5a-75c0-4751-ad54-095c9eb49e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:29.499642 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc9f5a-75c0-4751-ad54-095c9eb49e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:29.500453 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc9f5a-75c0-4751-ad54-095c9eb49e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:29.502547 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc9f5a-75c0-4751-ad54-095c9eb49e8d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:29.622497 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1350/2708] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:34:29 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:34:29.627345 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04feaad7-0c88-4128-b57d-0b3fecd39de9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:29.638701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04feaad7-0c88-4128-b57d-0b3fecd39de9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:29.723769 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfd886-74c3-423b-9c18-0be58cf5cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:29.724460 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfd886-74c3-423b-9c18-0be58cf5cd7f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:29.724750 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfd886-74c3-423b-9c18-0be58cf5cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:29.725060 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfd886-74c3-423b-9c18-0be58cf5cd7f admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:29.725784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfd886-74c3-423b-9c18-0be58cf5cd7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:29.727796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfd886-74c3-423b-9c18-0be58cf5cd7f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:29.863115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1359/2709] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:34:29 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:34:29.867079 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc9f5a-75c0-4751-ad54-095c9eb49e8d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:29.877718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc9f5a-75c0-4751-ad54-095c9eb49e8d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:29.882717 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c60d35-dcdc-471f-8262-10ad17e9d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:29.883480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60d35-dcdc-471f-8262-10ad17e9d20a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:29.883780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60d35-dcdc-471f-8262-10ad17e9d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:29.884033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60d35-dcdc-471f-8262-10ad17e9d20a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:29.884759 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c60d35-dcdc-471f-8262-10ad17e9d20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:29.886447 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c60d35-dcdc-471f-8262-10ad17e9d20a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:29.901760 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1351/2710] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:34:29.902968 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfd886-74c3-423b-9c18-0be58cf5cd7f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:29.915174 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfd886-74c3-423b-9c18-0be58cf5cd7f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:29.920101 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bd2b4-6807-4e13-b276-1759f51c616a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:29.922458 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bd2b4-6807-4e13-b276-1759f51c616a admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:29.922458 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bd2b4-6807-4e13-b276-1759f51c616a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:29.922458 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bd2b4-6807-4e13-b276-1759f51c616a admin admin] PATH_INFO: `/v3/projects/2bb21aa8491844cda2944c7ce94de6c7/users/454f60549ea44cc9a9fa1bfcd371cb6b/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:29.937794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bd2b4-6807-4e13-b276-1759f51c616a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb21aa8491844cda2944c7ce94de6c7, user_id=454f60549ea44cc9a9fa1bfcd371cb6b, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:29.940908 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bd2b4-6807-4e13-b276-1759f51c616a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:30.018421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1360/2711] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:34:29 2022] PUT /identity/v3/projects/2bb21aa8491844cda2944c7ce94de6c7/users/454f60549ea44cc9a9fa1bfcd371cb6b/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:34:30.022477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c60d35-dcdc-471f-8262-10ad17e9d20a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:30.033204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c60d35-dcdc-471f-8262-10ad17e9d20a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:30.094694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899bfa6-cad0-43b8-afcc-7da06b92363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:30.095360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899bfa6-cad0-43b8-afcc-7da06b92363c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:30.095641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899bfa6-cad0-43b8-afcc-7da06b92363c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:30.095915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899bfa6-cad0-43b8-afcc-7da06b92363c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:30.096638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899bfa6-cad0-43b8-afcc-7da06b92363c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:30.098258 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899bfa6-cad0-43b8-afcc-7da06b92363c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:30.107918 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1352/2712] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:34:30.112195 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bd2b4-6807-4e13-b276-1759f51c616a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:30.122745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bd2b4-6807-4e13-b276-1759f51c616a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:30.129141 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209605f0-cd8b-41e2-88eb-e3f36037af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:30.130234 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209605f0-cd8b-41e2-88eb-e3f36037af04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:30.130365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209605f0-cd8b-41e2-88eb-e3f36037af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:30.130639 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209605f0-cd8b-41e2-88eb-e3f36037af04 admin admin] PATH_INFO: `/v3/projects/2bb21aa8491844cda2944c7ce94de6c7/users/454f60549ea44cc9a9fa1bfcd371cb6b/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:30.132647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209605f0-cd8b-41e2-88eb-e3f36037af04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb21aa8491844cda2944c7ce94de6c7, user_id=454f60549ea44cc9a9fa1bfcd371cb6b, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:30.135420 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209605f0-cd8b-41e2-88eb-e3f36037af04 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:30.147213 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1361/2713] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:34:30 2022] PUT /identity/v3/projects/2bb21aa8491844cda2944c7ce94de6c7/users/454f60549ea44cc9a9fa1bfcd371cb6b/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:34:36.429688 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7579-2a1b-4d1a-a81f-b59a27e7f160 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:36.430143 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7579-2a1b-4d1a-a81f-b59a27e7f160 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:36.430266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7579-2a1b-4d1a-a81f-b59a27e7f160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:36.459450 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bb8b7579-2a1b-4d1a-a81f-b59a27e7f160 None None] MFA Rules not processed for user `454f60549ea44cc9a9fa1bfcd371cb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:34:36.460709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bb8b7579-2a1b-4d1a-a81f-b59a27e7f160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:36.529778 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1353/2714] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:34:36.542452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209605f0-cd8b-41e2-88eb-e3f36037af04 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:36.544177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-209605f0-cd8b-41e2-88eb-e3f36037af04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:36.600204 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209605f0-cd8b-41e2-88eb-e3f36037af04 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:36.604021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63172e6d-f16a-4f80-9b07-a349c27e5a99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ef8bbd229c488d97f167c810bc7cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:36.604667 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172e6d-f16a-4f80-9b07-a349c27e5a99 service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:36.604949 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172e6d-f16a-4f80-9b07-a349c27e5a99 service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:36.605247 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172e6d-f16a-4f80-9b07-a349c27e5a99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:36.661521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63172e6d-f16a-4f80-9b07-a349c27e5a99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:36.663028 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63172e6d-f16a-4f80-9b07-a349c27e5a99 service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:36.674235 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1362/2715] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:34:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:34:37.034728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0db12-7549-4fc2-bba2-15abc93e4781 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:37.035154 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0db12-7549-4fc2-bba2-15abc93e4781 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:37.035386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0db12-7549-4fc2-bba2-15abc93e4781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:37.054756 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-10c0db12-7549-4fc2-bba2-15abc93e4781 None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:34:37.055779 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-10c0db12-7549-4fc2-bba2-15abc93e4781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:37.112827 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1354/2716] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:34:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:34:37.126161 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63172e6d-f16a-4f80-9b07-a349c27e5a99 service glance] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:37.127595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-63172e6d-f16a-4f80-9b07-a349c27e5a99 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:37.201175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63172e6d-f16a-4f80-9b07-a349c27e5a99 service glance] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:37.203962 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c0652-a847-4a5e-a47b-852f52524786 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:37.204616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c0652-a847-4a5e-a47b-852f52524786 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:37.204896 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c0652-a847-4a5e-a47b-852f52524786 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:37.205305 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c0652-a847-4a5e-a47b-852f52524786 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:37.214219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c0652-a847-4a5e-a47b-852f52524786 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:37.216256 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c0652-a847-4a5e-a47b-852f52524786 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:37.225510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1363/2717] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:34:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 14:34:47.761062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a354c9-da05-4ae9-b4cf-3e831062d1ba None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:47.761716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a354c9-da05-4ae9-b4cf-3e831062d1ba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:47.761716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a354c9-da05-4ae9-b4cf-3e831062d1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:47.779561 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b7a354c9-da05-4ae9-b4cf-3e831062d1ba None None] MFA Rules not processed for user `9eb428022c154a529225e7d390318e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:34:47.789354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b7a354c9-da05-4ae9-b4cf-3e831062d1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:47.789354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1355/2718] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:34:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:34:51.265894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2da104-3e18-4ce2-81b6-6b1a2d5f823c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:51.267126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2da104-3e18-4ce2-81b6-6b1a2d5f823c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:51.267126 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2da104-3e18-4ce2-81b6-6b1a2d5f823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:51.284814 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ee2da104-3e18-4ce2-81b6-6b1a2d5f823c None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:34:51.286072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ee2da104-3e18-4ce2-81b6-6b1a2d5f823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:34:51.293516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1364/2719] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Apr 12 14:34:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:34:51.307231 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a354c9-da05-4ae9-b4cf-3e831062d1ba None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:34:51.319855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a354c9-da05-4ae9-b4cf-3e831062d1ba None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:34:51.324838 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08487fb-0f4d-480b-86c5-628499513ce1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:34:51.325523 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08487fb-0f4d-480b-86c5-628499513ce1 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:34:51.325810 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08487fb-0f4d-480b-86c5-628499513ce1 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:34:51.326092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08487fb-0f4d-480b-86c5-628499513ce1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:34:51.334769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08487fb-0f4d-480b-86c5-628499513ce1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:34:51.336343 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08487fb-0f4d-480b-86c5-628499513ce1 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:34:51.344568 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1356/2720] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:34:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 14:35:15.189584 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2da104-3e18-4ce2-81b6-6b1a2d5f823c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:35:15.190980 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ee2da104-3e18-4ce2-81b6-6b1a2d5f823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:35:15.246983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2da104-3e18-4ce2-81b6-6b1a2d5f823c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:35:15.251237 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350524c1-b614-4f28-9293-9323c12f842b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:35:15.251851 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350524c1-b614-4f28-9293-9323c12f842b service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:35:15.252134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350524c1-b614-4f28-9293-9323c12f842b service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:35:15.252410 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350524c1-b614-4f28-9293-9323c12f842b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:35:15.254210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-350524c1-b614-4f28-9293-9323c12f842b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:35:15.314711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350524c1-b614-4f28-9293-9323c12f842b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:35:15.316172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350524c1-b614-4f28-9293-9323c12f842b service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:35:15.325743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1365/2721] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:35:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:35:21.224905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08487fb-0f4d-480b-86c5-628499513ce1 service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:35:21.293737 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08487fb-0f4d-480b-86c5-628499513ce1 service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:35:21.299027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7053f90-cd45-497d-bb7f-d4a5e049ece2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:35:21.299747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053f90-cd45-497d-bb7f-d4a5e049ece2 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:35:21.300151 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053f90-cd45-497d-bb7f-d4a5e049ece2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:35:21.300511 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053f90-cd45-497d-bb7f-d4a5e049ece2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:35:21.311288 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7053f90-cd45-497d-bb7f-d4a5e049ece2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:35:21.314144 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7053f90-cd45-497d-bb7f-d4a5e049ece2 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:35:21.326033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1357/2722] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:35:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:35:23.848163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa870e-dade-4177-b9a9-9b4fb7480394 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:35:23.848808 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa870e-dade-4177-b9a9-9b4fb7480394 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:35:23.849260 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa870e-dade-4177-b9a9-9b4fb7480394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:35:23.879162 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-95fa870e-dade-4177-b9a9-9b4fb7480394 None None] MFA Rules not processed for user `590232e0efa742f1a4c273259fd2531b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:35:23.880406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-95fa870e-dade-4177-b9a9-9b4fb7480394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:35:23.889621 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1366/2723] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:35:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:35:41.769010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7053f90-cd45-497d-bb7f-d4a5e049ece2 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:35:41.770199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b7053f90-cd45-497d-bb7f-d4a5e049ece2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:35:41.784039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7053f90-cd45-497d-bb7f-d4a5e049ece2 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:35:41.788239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f1e44-e3c3-41ae-9fbf-675cf9a6ff87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:35:41.788907 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f1e44-e3c3-41ae-9fbf-675cf9a6ff87 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:35:41.789222 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f1e44-e3c3-41ae-9fbf-675cf9a6ff87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:35:41.789499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f1e44-e3c3-41ae-9fbf-675cf9a6ff87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:35:41.792216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c86f1e44-e3c3-41ae-9fbf-675cf9a6ff87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:35:41.869293 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f1e44-e3c3-41ae-9fbf-675cf9a6ff87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:35:41.870734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f1e44-e3c3-41ae-9fbf-675cf9a6ff87 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:35:41.882801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1358/2724] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:35:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:35:43.141964 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa870e-dade-4177-b9a9-9b4fb7480394 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:35:43.152084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa870e-dade-4177-b9a9-9b4fb7480394 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:35:43.156468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354597-5e0c-43e6-af2c-002c47c199dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:35:43.157184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354597-5e0c-43e6-af2c-002c47c199dd service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:35:43.157470 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354597-5e0c-43e6-af2c-002c47c199dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:35:43.157746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354597-5e0c-43e6-af2c-002c47c199dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:35:43.159599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-be354597-5e0c-43e6-af2c-002c47c199dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:35:43.174021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be354597-5e0c-43e6-af2c-002c47c199dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:35:43.175476 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be354597-5e0c-43e6-af2c-002c47c199dd service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:35:43.188477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1367/2725] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:35:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:36:39.040612 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f1e44-e3c3-41ae-9fbf-675cf9a6ff87 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:36:39.042741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c86f1e44-e3c3-41ae-9fbf-675cf9a6ff87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:39.064679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f1e44-e3c3-41ae-9fbf-675cf9a6ff87 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:36:39.073196 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807db32-a9ea-4ece-a53f-9557280a4f99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:36:39.082549 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807db32-a9ea-4ece-a53f-9557280a4f99 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:39.082549 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807db32-a9ea-4ece-a53f-9557280a4f99 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:39.082549 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807db32-a9ea-4ece-a53f-9557280a4f99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:39.082549 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9807db32-a9ea-4ece-a53f-9557280a4f99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:39.106538 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807db32-a9ea-4ece-a53f-9557280a4f99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:36:39.109266 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807db32-a9ea-4ece-a53f-9557280a4f99 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:36:39.123580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1359/2726] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:36:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:36:40.445676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354597-5e0c-43e6-af2c-002c47c199dd service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:36:40.454697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354597-5e0c-43e6-af2c-002c47c199dd service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:36:40.458568 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2938df0-1da6-4dbd-9fa7-deee35d4548e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:36:40.459353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2938df0-1da6-4dbd-9fa7-deee35d4548e service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:40.459717 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2938df0-1da6-4dbd-9fa7-deee35d4548e service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:40.460067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2938df0-1da6-4dbd-9fa7-deee35d4548e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:40.463550 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b2938df0-1da6-4dbd-9fa7-deee35d4548e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:40.474823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2938df0-1da6-4dbd-9fa7-deee35d4548e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:36:40.476328 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2938df0-1da6-4dbd-9fa7-deee35d4548e service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:36:40.485685 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1368/2727] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:36:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:36:41.694110 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807db32-a9ea-4ece-a53f-9557280a4f99 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:36:41.697718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9807db32-a9ea-4ece-a53f-9557280a4f99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:41.721671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807db32-a9ea-4ece-a53f-9557280a4f99 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:36:41.732167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f278081-a270-438a-84bd-9dc25ba96eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:36:41.733538 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f278081-a270-438a-84bd-9dc25ba96eed service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:41.733817 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f278081-a270-438a-84bd-9dc25ba96eed service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:41.734090 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f278081-a270-438a-84bd-9dc25ba96eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:41.736375 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7f278081-a270-438a-84bd-9dc25ba96eed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:41.757844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f278081-a270-438a-84bd-9dc25ba96eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:36:41.759762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f278081-a270-438a-84bd-9dc25ba96eed service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:36:41.777378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1360/2728] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:36:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:36:47.127359 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d601463-5880-4d17-99e2-50f32e4cb1a8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:47.127844 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d601463-5880-4d17-99e2-50f32e4cb1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:47.127972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d601463-5880-4d17-99e2-50f32e4cb1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:47.146402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8d601463-5880-4d17-99e2-50f32e4cb1a8 None None] MFA Rules not processed for user `f75379cfab784101ab4a5abd506c3270`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:36:47.152658 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8d601463-5880-4d17-99e2-50f32e4cb1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:47.204193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1369/2729] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:36:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:36:47.668341 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fc9ab-c12c-44be-a1eb-b4c6fc108de9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:47.668800 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fc9ab-c12c-44be-a1eb-b4c6fc108de9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:47.668895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fc9ab-c12c-44be-a1eb-b4c6fc108de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:47.690136 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4f3fc9ab-c12c-44be-a1eb-b4c6fc108de9 None None] MFA Rules not processed for user `e84a4f86f4c54625a22cfdcbc08da73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:36:47.692257 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4f3fc9ab-c12c-44be-a1eb-b4c6fc108de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:47.705588 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1361/2730] 10.222.0.61 () {58 vars in 967 bytes} [Tue Apr 12 14:36:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:36:47.754630 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d601463-5880-4d17-99e2-50f32e4cb1a8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:36:47.770941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d601463-5880-4d17-99e2-50f32e4cb1a8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:36:47.776520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95cb55-4ae5-4c17-ae09-64bb7c1ebed3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987dcad83b914b5894955dfe3e1f71ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:36:47.777319 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95cb55-4ae5-4c17-ae09-64bb7c1ebed3 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:47.777606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95cb55-4ae5-4c17-ae09-64bb7c1ebed3 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:47.777881 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95cb55-4ae5-4c17-ae09-64bb7c1ebed3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:47.787503 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95cb55-4ae5-4c17-ae09-64bb7c1ebed3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:36:47.789111 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95cb55-4ae5-4c17-ae09-64bb7c1ebed3 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:36:47.797871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1370/2731] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Apr 12 14:36:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 14:36:47.925281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fc9ab-c12c-44be-a1eb-b4c6fc108de9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:36:47.926682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4f3fc9ab-c12c-44be-a1eb-b4c6fc108de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:47.998567 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fc9ab-c12c-44be-a1eb-b4c6fc108de9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:36:48.003466 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b9fc1-8e00-4c39-8595-a9e78ce0f738 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7095f3ab8545c589d4d28a846ba1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:36:48.004113 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b9fc1-8e00-4c39-8595-a9e78ce0f738 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:48.004398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b9fc1-8e00-4c39-8595-a9e78ce0f738 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:48.004676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b9fc1-8e00-4c39-8595-a9e78ce0f738 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:48.006454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fe1b9fc1-8e00-4c39-8595-a9e78ce0f738 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:48.019203 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b9fc1-8e00-4c39-8595-a9e78ce0f738 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:36:48.020824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b9fc1-8e00-4c39-8595-a9e78ce0f738 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:36:48.033024 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1362/2732] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:36:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:36:56.932759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95cb55-4ae5-4c17-ae09-64bb7c1ebed3 service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:36:57.000225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95cb55-4ae5-4c17-ae09-64bb7c1ebed3 service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:36:57.005225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:36:57.006113 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:57.006396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:57.006670 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] PATH_INFO: `/v3/users/9eb428022c154a529225e7d390318e82` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:57.007923 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb428022c154a529225e7d390318e82)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:36:57.009883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:36:57.228948 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb428022c154a529225e7d390318e82'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:57.249727 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb428022c154a529225e7d390318e82'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:57.250676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb428022c154a529225e7d390318e82'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:57.262312 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb428022c154a529225e7d390318e82'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:57.264008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb428022c154a529225e7d390318e82'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:57.347445 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1371/2733] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:36:56 2022] DELETE /identity/v3/users/9eb428022c154a529225e7d390318e82 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:36:57.659062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b9fc1-8e00-4c39-8595-a9e78ce0f738 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:36:57.675255 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b9fc1-8e00-4c39-8595-a9e78ce0f738 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:36:57.739201 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:36:57.739993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:57.740275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:57.740553 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] PATH_INFO: `/v3/projects/4a2b25630afa4793a520fafc47c2c2ff` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:57.741819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a2b25630afa4793a520fafc47c2c2ff)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:36:57.743877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:36:57.862837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a2b25630afa4793a520fafc47c2c2ff', 'request_id': 'req-566db6ae-e227-4791-be8e-227f682b192b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:57.957582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a2b25630afa4793a520fafc47c2c2ff', 'request_id': 'req-566db6ae-e227-4791-be8e-227f682b192b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:57.965286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a2b25630afa4793a520fafc47c2c2ff', 'request_id': 'req-566db6ae-e227-4791-be8e-227f682b192b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:57.976202 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] The token cache is being invalidate because project 4a2b25630afa4793a520fafc47c2c2ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:36:57.976504 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:57.977199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:57.978829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1363/2734] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:36:57 2022] DELETE /identity/v3/projects/4a2b25630afa4793a520fafc47c2c2ff => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:36:57.983422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:36:57.985208 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:58.003516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f1390-e33d-430b-a6da-4b214b9bb85a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:36:58.072737 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:36:58.073698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:58.073979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:58.074257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] PATH_INFO: `/v3/users/454f60549ea44cc9a9fa1bfcd371cb6b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:58.075783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=454f60549ea44cc9a9fa1bfcd371cb6b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:36:58.077862 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:36:58.283582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454f60549ea44cc9a9fa1bfcd371cb6b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:58.296402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454f60549ea44cc9a9fa1bfcd371cb6b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:58.297171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454f60549ea44cc9a9fa1bfcd371cb6b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:58.304394 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454f60549ea44cc9a9fa1bfcd371cb6b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:58.305195 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454f60549ea44cc9a9fa1bfcd371cb6b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:58.374103 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:36:58.375626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:58.377429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1372/2735] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:36:57 2022] DELETE /identity/v3/users/454f60549ea44cc9a9fa1bfcd371cb6b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:36:58.473994 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566db6ae-e227-4791-be8e-227f682b192b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:36:58.578545 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cccbe-22f9-4051-af9a-4b8e070d420b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:36:58.579663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cccbe-22f9-4051-af9a-4b8e070d420b service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:58.580200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cccbe-22f9-4051-af9a-4b8e070d420b service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:58.580704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cccbe-22f9-4051-af9a-4b8e070d420b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:58.583423 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4f6cccbe-22f9-4051-af9a-4b8e070d420b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:58.600345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cccbe-22f9-4051-af9a-4b8e070d420b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:36:58.602234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cccbe-22f9-4051-af9a-4b8e070d420b service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:36:58.614824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1364/2736] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:36:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:36:58.750284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:36:58.752762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:36:58.840009 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e1338-7ab1-4f19-9c35-8ceb117d6d3c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:36:58.847984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:36:58.849708 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:36:58.850218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:36:58.850703 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] PATH_INFO: `/v3/projects/2bb21aa8491844cda2944c7ce94de6c7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:36:58.852850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb21aa8491844cda2944c7ce94de6c7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:36:58.858008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:36:58.971999 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb21aa8491844cda2944c7ce94de6c7', 'request_id': 'req-e4b19a0c-dac6-430a-8a06-1945ae0bed74'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:59.027759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb21aa8491844cda2944c7ce94de6c7', 'request_id': 'req-e4b19a0c-dac6-430a-8a06-1945ae0bed74'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:59.039393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb21aa8491844cda2944c7ce94de6c7', 'request_id': 'req-e4b19a0c-dac6-430a-8a06-1945ae0bed74'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:59.052957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] The token cache is being invalidate because project 2bb21aa8491844cda2944c7ce94de6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:36:59.053578 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:59.054358 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:36:59.056275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1373/2737] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:36:58 2022] DELETE /identity/v3/projects/2bb21aa8491844cda2944c7ce94de6c7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:37:30.097789 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cccbe-22f9-4051-af9a-4b8e070d420b service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:37:30.101483 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4f6cccbe-22f9-4051-af9a-4b8e070d420b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:37:30.214664 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cccbe-22f9-4051-af9a-4b8e070d420b service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:37:30.267646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83462a-e0f6-46fe-8831-c47ec5301735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:37:30.268303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83462a-e0f6-46fe-8831-c47ec5301735 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:37:30.268582 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83462a-e0f6-46fe-8831-c47ec5301735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:37:30.268856 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83462a-e0f6-46fe-8831-c47ec5301735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:37:30.270670 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5b83462a-e0f6-46fe-8831-c47ec5301735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:37:30.383882 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83462a-e0f6-46fe-8831-c47ec5301735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:37:30.385345 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83462a-e0f6-46fe-8831-c47ec5301735 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:37:30.407652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1365/2738] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:37:39.803699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:37:39.806020 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:37:39.896259 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b19a0c-dac6-430a-8a06-1945ae0bed74 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:37:39.902825 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:37:39.903994 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:37:39.904321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:37:39.904634 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] PATH_INFO: `/v3/users/590232e0efa742f1a4c273259fd2531b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:37:39.906228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590232e0efa742f1a4c273259fd2531b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:37:39.908518 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:37:40.121240 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590232e0efa742f1a4c273259fd2531b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:40.135393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590232e0efa742f1a4c273259fd2531b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:40.135393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590232e0efa742f1a4c273259fd2531b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:40.143855 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590232e0efa742f1a4c273259fd2531b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:40.144663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590232e0efa742f1a4c273259fd2531b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:40.222562 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1374/2739] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:37:39 2022] DELETE /identity/v3/users/590232e0efa742f1a4c273259fd2531b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:37:40.528060 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83462a-e0f6-46fe-8831-c47ec5301735 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:37:40.541336 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83462a-e0f6-46fe-8831-c47ec5301735 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:37:40.623460 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:37:40.624389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:37:40.624715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:37:40.625171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] PATH_INFO: `/v3/projects/47cdab1e9b464fd2974ee31d4ab20865` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:37:40.626490 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cdab1e9b464fd2974ee31d4ab20865)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:37:40.628812 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:37:40.753633 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cdab1e9b464fd2974ee31d4ab20865', 'request_id': 'req-9089affd-9816-426a-ac36-e7295848dd66'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:40.855035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cdab1e9b464fd2974ee31d4ab20865', 'request_id': 'req-9089affd-9816-426a-ac36-e7295848dd66'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:40.863126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cdab1e9b464fd2974ee31d4ab20865', 'request_id': 'req-9089affd-9816-426a-ac36-e7295848dd66'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:40.876286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] The token cache is being invalidate because project 47cdab1e9b464fd2974ee31d4ab20865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:37:40.876637 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:40.877634 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:40.879438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1366/2740] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:37:40 2022] DELETE /identity/v3/projects/47cdab1e9b464fd2974ee31d4ab20865 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:37:40.884061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:37:40.885615 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:37:40.900735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55cfce-2558-473f-8c8f-4493243a69b1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:37:40.984380 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:37:40.985197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:37:40.985487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:37:40.985762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] PATH_INFO: `/v3/users/134aa8ad42c647fe9f1547fbb2eb520c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:37:40.987086 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=134aa8ad42c647fe9f1547fbb2eb520c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:37:40.989100 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:37:41.208731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134aa8ad42c647fe9f1547fbb2eb520c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:41.223872 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134aa8ad42c647fe9f1547fbb2eb520c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:41.225091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134aa8ad42c647fe9f1547fbb2eb520c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:41.234316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134aa8ad42c647fe9f1547fbb2eb520c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:41.235121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134aa8ad42c647fe9f1547fbb2eb520c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:41.312756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1375/2741] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:37:40 2022] DELETE /identity/v3/users/134aa8ad42c647fe9f1547fbb2eb520c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:37:41.622397 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:37:41.623996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:37:41.647610 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089affd-9816-426a-ac36-e7295848dd66 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:37:41.718159 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:37:41.719145 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:37:41.719467 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:37:41.719997 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] PATH_INFO: `/v3/projects/214c698cc01e4477812b4655b70a1d4b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:37:41.721319 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=214c698cc01e4477812b4655b70a1d4b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:37:41.723819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:37:41.846575 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214c698cc01e4477812b4655b70a1d4b', 'request_id': 'req-05ce99c4-0858-474e-ba5c-14b00feee23e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:41.922960 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214c698cc01e4477812b4655b70a1d4b', 'request_id': 'req-05ce99c4-0858-474e-ba5c-14b00feee23e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:41.931517 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214c698cc01e4477812b4655b70a1d4b', 'request_id': 'req-05ce99c4-0858-474e-ba5c-14b00feee23e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:41.945105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] The token cache is being invalidate because project 214c698cc01e4477812b4655b70a1d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:37:41.945625 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:41.946679 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:37:41.948279 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1367/2742] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:37:41 2022] DELETE /identity/v3/projects/214c698cc01e4477812b4655b70a1d4b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:38:12.355659 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:12.357294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:12.418744 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15661efc-a961-4a61-bfa7-7a0a6c2b16ea admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:12.471279 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af059a02-63e4-4ddf-a4b0-06f61c01353b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:12.472031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af059a02-63e4-4ddf-a4b0-06f61c01353b service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:12.472360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af059a02-63e4-4ddf-a4b0-06f61c01353b service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:12.472680 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af059a02-63e4-4ddf-a4b0-06f61c01353b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:12.474853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-af059a02-63e4-4ddf-a4b0-06f61c01353b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:12.542153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af059a02-63e4-4ddf-a4b0-06f61c01353b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:12.543697 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af059a02-63e4-4ddf-a4b0-06f61c01353b service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:12.554168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1376/2743] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:38:16.641102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:16.648564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:16.662996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce99c4-0858-474e-ba5c-14b00feee23e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:16.675518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40125a-a9ff-45b4-8240-af28318c5690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:16.675518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40125a-a9ff-45b4-8240-af28318c5690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:16.675518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40125a-a9ff-45b4-8240-af28318c5690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:16.675518 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40125a-a9ff-45b4-8240-af28318c5690 admin admin] PATH_INFO: `/v3/users/f75379cfab784101ab4a5abd506c3270` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:16.676185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40125a-a9ff-45b4-8240-af28318c5690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75379cfab784101ab4a5abd506c3270)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:16.680096 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40125a-a9ff-45b4-8240-af28318c5690 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:16.873638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb40125a-a9ff-45b4-8240-af28318c5690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75379cfab784101ab4a5abd506c3270'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:16.888695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb40125a-a9ff-45b4-8240-af28318c5690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75379cfab784101ab4a5abd506c3270'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:16.974085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb40125a-a9ff-45b4-8240-af28318c5690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75379cfab784101ab4a5abd506c3270'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:16.982876 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb40125a-a9ff-45b4-8240-af28318c5690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75379cfab784101ab4a5abd506c3270'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:16.983614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb40125a-a9ff-45b4-8240-af28318c5690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75379cfab784101ab4a5abd506c3270'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:16.989796 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1368/2744] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:38:16 2022] DELETE /identity/v3/users/f75379cfab784101ab4a5abd506c3270 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:17.253558 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af059a02-63e4-4ddf-a4b0-06f61c01353b service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:17.264882 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af059a02-63e4-4ddf-a4b0-06f61c01353b service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:17.356012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:17.357007 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:17.357393 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:17.357794 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] PATH_INFO: `/v3/projects/5db8f744906b4260b9dfb77d972dc484` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:17.359425 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db8f744906b4260b9dfb77d972dc484)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:17.362231 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:17.479122 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db8f744906b4260b9dfb77d972dc484', 'request_id': 'req-2fdff378-fde1-4735-91a8-f7a69f111fb6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:17.534047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db8f744906b4260b9dfb77d972dc484', 'request_id': 'req-2fdff378-fde1-4735-91a8-f7a69f111fb6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:17.541802 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db8f744906b4260b9dfb77d972dc484', 'request_id': 'req-2fdff378-fde1-4735-91a8-f7a69f111fb6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:17.552117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] The token cache is being invalidate because project 5db8f744906b4260b9dfb77d972dc484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:38:17.552391 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:17.553109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fdff378-fde1-4735-91a8-f7a69f111fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:17.554686 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1377/2745] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:38:17 2022] DELETE /identity/v3/projects/5db8f744906b4260b9dfb77d972dc484 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:17.560627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2ef5c-e217-48d8-af85-bb34f0800c85 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:17.560940 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2ef5c-e217-48d8-af85-bb34f0800c85 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:17.561244 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2ef5c-e217-48d8-af85-bb34f0800c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:17.624187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-21d2ef5c-e217-48d8-af85-bb34f0800c85 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:17.625762 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-21d2ef5c-e217-48d8-af85-bb34f0800c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:17.686813 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1369/2746] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:17.695826 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99f851-8458-4a9b-9c44-443cab1300c7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:17.696109 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99f851-8458-4a9b-9c44-443cab1300c7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:17.696387 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99f851-8458-4a9b-9c44-443cab1300c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:17.716098 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8b99f851-8458-4a9b-9c44-443cab1300c7 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:17.717404 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8b99f851-8458-4a9b-9c44-443cab1300c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:17.725582 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1378/2747] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:17.729924 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2ef5c-e217-48d8-af85-bb34f0800c85 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:17.739851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2ef5c-e217-48d8-af85-bb34f0800c85 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:17.745377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e033523-41f0-4732-b2c7-d583f001de64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:17.746049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e033523-41f0-4732-b2c7-d583f001de64 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:17.746334 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e033523-41f0-4732-b2c7-d583f001de64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:17.746750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e033523-41f0-4732-b2c7-d583f001de64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:17.747524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e033523-41f0-4732-b2c7-d583f001de64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:38:17.747833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e033523-41f0-4732-b2c7-d583f001de64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:17.749521 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e033523-41f0-4732-b2c7-d583f001de64 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:17.764761 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1370/2748] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:38:17.769277 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99f851-8458-4a9b-9c44-443cab1300c7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:17.779198 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99f851-8458-4a9b-9c44-443cab1300c7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:17.784572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3079b74-af24-41f5-b9be-c7a08848e05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:17.785212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3079b74-af24-41f5-b9be-c7a08848e05a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:17.785489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3079b74-af24-41f5-b9be-c7a08848e05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:17.785761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3079b74-af24-41f5-b9be-c7a08848e05a admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:17.786488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3079b74-af24-41f5-b9be-c7a08848e05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:17.788462 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3079b74-af24-41f5-b9be-c7a08848e05a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:17.925402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1379/2749] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:38:17 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:38:17.929904 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e033523-41f0-4732-b2c7-d583f001de64 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:17.941584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e033523-41f0-4732-b2c7-d583f001de64 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:18.022366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308840dd-a42d-46ae-99f4-8087234ab763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:18.023034 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308840dd-a42d-46ae-99f4-8087234ab763 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:18.023321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308840dd-a42d-46ae-99f4-8087234ab763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:18.023594 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308840dd-a42d-46ae-99f4-8087234ab763 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:18.024287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308840dd-a42d-46ae-99f4-8087234ab763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:18.026317 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308840dd-a42d-46ae-99f4-8087234ab763 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:18.158813 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1371/2750] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:38:17 2022] POST /identity/v3/users => generated 283 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:38:18.163482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3079b74-af24-41f5-b9be-c7a08848e05a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:18.175616 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3079b74-af24-41f5-b9be-c7a08848e05a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:18.180853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c58c99-0506-4dc5-8357-a5b1c1e74fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:18.182114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c58c99-0506-4dc5-8357-a5b1c1e74fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:18.182402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c58c99-0506-4dc5-8357-a5b1c1e74fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:18.182715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c58c99-0506-4dc5-8357-a5b1c1e74fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:18.183474 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c58c99-0506-4dc5-8357-a5b1c1e74fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:18.185296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c58c99-0506-4dc5-8357-a5b1c1e74fd8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:18.198061 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1380/2751] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:18.202675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308840dd-a42d-46ae-99f4-8087234ab763 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:18.215374 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308840dd-a42d-46ae-99f4-8087234ab763 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:18.221863 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc914b-c69f-4eaf-93b8-56040df79fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:18.222692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc914b-c69f-4eaf-93b8-56040df79fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:18.223056 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc914b-c69f-4eaf-93b8-56040df79fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:18.223485 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc914b-c69f-4eaf-93b8-56040df79fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:18.224349 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc914b-c69f-4eaf-93b8-56040df79fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:18.226280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc914b-c69f-4eaf-93b8-56040df79fc7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:18.240382 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1372/2752] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:18.247897 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c58c99-0506-4dc5-8357-a5b1c1e74fd8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:18.266125 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c58c99-0506-4dc5-8357-a5b1c1e74fd8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:18.273726 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ff7bc-cfff-411d-b139-ae2c13dc5cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:18.276577 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ff7bc-cfff-411d-b139-ae2c13dc5cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:18.277050 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ff7bc-cfff-411d-b139-ae2c13dc5cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:18.277545 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ff7bc-cfff-411d-b139-ae2c13dc5cd4 admin admin] PATH_INFO: `/v3/projects/7265d2c3d546447a9d97128a8abd1f23/users/944ab6cbf63a4f7a8823eb9b1199e6f4/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:18.297221 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ff7bc-cfff-411d-b139-ae2c13dc5cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7265d2c3d546447a9d97128a8abd1f23, user_id=944ab6cbf63a4f7a8823eb9b1199e6f4, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:18.300274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ff7bc-cfff-411d-b139-ae2c13dc5cd4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:18.392637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1381/2753] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:18 2022] PUT /identity/v3/projects/7265d2c3d546447a9d97128a8abd1f23/users/944ab6cbf63a4f7a8823eb9b1199e6f4/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:18.404501 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d11e66-0b1c-4c5b-9f7a-1603baf8d9bc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:18.404780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d11e66-0b1c-4c5b-9f7a-1603baf8d9bc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:18.405093 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d11e66-0b1c-4c5b-9f7a-1603baf8d9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:18.443673 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e0d11e66-0b1c-4c5b-9f7a-1603baf8d9bc None None] MFA Rules not processed for user `944ab6cbf63a4f7a8823eb9b1199e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:18.446000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e0d11e66-0b1c-4c5b-9f7a-1603baf8d9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:18.543609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1373/2754] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:38:18.549042 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ff7bc-cfff-411d-b139-ae2c13dc5cd4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:18.620513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ff7bc-cfff-411d-b139-ae2c13dc5cd4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:18.625676 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90d566-f21d-4be6-9ad2-e6453af8cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:18.626369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90d566-f21d-4be6-9ad2-e6453af8cc9f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:18.626656 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90d566-f21d-4be6-9ad2-e6453af8cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:18.626931 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90d566-f21d-4be6-9ad2-e6453af8cc9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:18.627633 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90d566-f21d-4be6-9ad2-e6453af8cc9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:18.629743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90d566-f21d-4be6-9ad2-e6453af8cc9f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:18.740800 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1382/2755] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:38:18 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:38:18.745236 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d11e66-0b1c-4c5b-9f7a-1603baf8d9bc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:18.756552 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d11e66-0b1c-4c5b-9f7a-1603baf8d9bc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:18.838424 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caae415-e339-49c4-b2aa-9c2d547c226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:18.839859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caae415-e339-49c4-b2aa-9c2d547c226b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:18.840364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caae415-e339-49c4-b2aa-9c2d547c226b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:18.840849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caae415-e339-49c4-b2aa-9c2d547c226b admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:18.842235 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caae415-e339-49c4-b2aa-9c2d547c226b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:18.846087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caae415-e339-49c4-b2aa-9c2d547c226b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:18.946477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1374/2756] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:38:18 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:38:18.951278 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90d566-f21d-4be6-9ad2-e6453af8cc9f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:18.963507 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90d566-f21d-4be6-9ad2-e6453af8cc9f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:18.968599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30926d-57f1-4455-abc1-2a04af8354f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:18.969342 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30926d-57f1-4455-abc1-2a04af8354f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:18.969625 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30926d-57f1-4455-abc1-2a04af8354f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:18.969903 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30926d-57f1-4455-abc1-2a04af8354f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:18.970651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30926d-57f1-4455-abc1-2a04af8354f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:18.972382 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30926d-57f1-4455-abc1-2a04af8354f0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:18.986636 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1383/2757] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:18.999217 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caae415-e339-49c4-b2aa-9c2d547c226b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:19.010239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caae415-e339-49c4-b2aa-9c2d547c226b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:19.016512 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acc84e-b685-4ba4-bf58-4719e4e82f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:19.017606 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acc84e-b685-4ba4-bf58-4719e4e82f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:19.018622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acc84e-b685-4ba4-bf58-4719e4e82f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:19.018622 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acc84e-b685-4ba4-bf58-4719e4e82f58 admin admin] PATH_INFO: `/v3/projects/4a471c7291f4408db8ba68057d9d6c2f/users/e17004426676433aa6b0104d50ed6435/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:19.036172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acc84e-b685-4ba4-bf58-4719e4e82f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a471c7291f4408db8ba68057d9d6c2f, user_id=e17004426676433aa6b0104d50ed6435, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:19.039398 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acc84e-b685-4ba4-bf58-4719e4e82f58 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:19.151902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1375/2758] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:18 2022] PUT /identity/v3/projects/4a471c7291f4408db8ba68057d9d6c2f/users/e17004426676433aa6b0104d50ed6435/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:19.153308 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30926d-57f1-4455-abc1-2a04af8354f0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:19.164000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30926d-57f1-4455-abc1-2a04af8354f0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:19.226818 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3579d5-7280-4d31-a386-61f8f3f10c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:19.227499 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3579d5-7280-4d31-a386-61f8f3f10c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:19.227831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3579d5-7280-4d31-a386-61f8f3f10c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:19.228627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3579d5-7280-4d31-a386-61f8f3f10c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:19.229586 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3579d5-7280-4d31-a386-61f8f3f10c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:19.231225 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3579d5-7280-4d31-a386-61f8f3f10c01 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:19.241976 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1384/2759] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:38:19.246931 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acc84e-b685-4ba4-bf58-4719e4e82f58 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:19.257804 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acc84e-b685-4ba4-bf58-4719e4e82f58 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:19.263324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3555f3-6f1d-464b-ac2d-fe422ff9dbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:19.264246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3555f3-6f1d-464b-ac2d-fe422ff9dbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:19.264526 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3555f3-6f1d-464b-ac2d-fe422ff9dbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:19.264798 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3555f3-6f1d-464b-ac2d-fe422ff9dbdd admin admin] PATH_INFO: `/v3/projects/4a471c7291f4408db8ba68057d9d6c2f/users/e17004426676433aa6b0104d50ed6435/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:19.266936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3555f3-6f1d-464b-ac2d-fe422ff9dbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a471c7291f4408db8ba68057d9d6c2f, user_id=e17004426676433aa6b0104d50ed6435, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:19.269628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3555f3-6f1d-464b-ac2d-fe422ff9dbdd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:19.282124 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1376/2760] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:19 2022] PUT /identity/v3/projects/4a471c7291f4408db8ba68057d9d6c2f/users/e17004426676433aa6b0104d50ed6435/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:19.295163 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeced4c-3e19-4c9c-8e19-e49f89ced296 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:19.296076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeced4c-3e19-4c9c-8e19-e49f89ced296 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:19.296076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeced4c-3e19-4c9c-8e19-e49f89ced296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:19.325174 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5aeced4c-3e19-4c9c-8e19-e49f89ced296 None None] MFA Rules not processed for user `e17004426676433aa6b0104d50ed6435`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:19.326504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5aeced4c-3e19-4c9c-8e19-e49f89ced296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:19.450619 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1385/2761] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:19.463808 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3555f3-6f1d-464b-ac2d-fe422ff9dbdd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:19.465767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0f3555f3-6f1d-464b-ac2d-fe422ff9dbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:19.558188 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3555f3-6f1d-464b-ac2d-fe422ff9dbdd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:19.561892 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaa270-f977-448b-ba37-9d8e46a07062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:19.562558 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaa270-f977-448b-ba37-9d8e46a07062 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:19.562830 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaa270-f977-448b-ba37-9d8e46a07062 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:19.563104 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaa270-f977-448b-ba37-9d8e46a07062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:19.574316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaa270-f977-448b-ba37-9d8e46a07062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:19.575828 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaa270-f977-448b-ba37-9d8e46a07062 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:19.586913 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1377/2762] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:38:19.826434 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeced4c-3e19-4c9c-8e19-e49f89ced296 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:19.837205 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeced4c-3e19-4c9c-8e19-e49f89ced296 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:19.841818 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fd4d5-f627-46d2-b883-254e9b14ea73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:19.842479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd4d5-f627-46d2-b883-254e9b14ea73 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:19.842757 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd4d5-f627-46d2-b883-254e9b14ea73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:19.843031 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd4d5-f627-46d2-b883-254e9b14ea73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:19.911797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fd4d5-f627-46d2-b883-254e9b14ea73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:19.913767 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fd4d5-f627-46d2-b883-254e9b14ea73 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:19.924954 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1386/2763] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:38:31.207958 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaa270-f977-448b-ba37-9d8e46a07062 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:31.286376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaa270-f977-448b-ba37-9d8e46a07062 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:31.291186 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:31.292168 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:31.292422 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:31.292700 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] PATH_INFO: `/v3/users/944ab6cbf63a4f7a8823eb9b1199e6f4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:31.293984 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=944ab6cbf63a4f7a8823eb9b1199e6f4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:31.295958 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:31.496897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944ab6cbf63a4f7a8823eb9b1199e6f4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:31.509927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944ab6cbf63a4f7a8823eb9b1199e6f4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:31.578228 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944ab6cbf63a4f7a8823eb9b1199e6f4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:31.586001 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944ab6cbf63a4f7a8823eb9b1199e6f4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:31.587565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944ab6cbf63a4f7a8823eb9b1199e6f4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:31.593041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1378/2764] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:38:31 2022] DELETE /identity/v3/users/944ab6cbf63a4f7a8823eb9b1199e6f4 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:31.598021 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70658079-2c8f-41c2-ad80-2b1db523d913 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:31.598644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70658079-2c8f-41c2-ad80-2b1db523d913 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:31.598644 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70658079-2c8f-41c2-ad80-2b1db523d913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:31.618796 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-70658079-2c8f-41c2-ad80-2b1db523d913 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:31.620099 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-70658079-2c8f-41c2-ad80-2b1db523d913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:31.682081 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1387/2765] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:38:31.691832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:31.693278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:31.753012 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3a2f-51ea-461c-a0a9-727753452883 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:31.756611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa4e03-edb2-41da-8949-836b31c53ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:31.757281 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa4e03-edb2-41da-8949-836b31c53ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:31.757566 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa4e03-edb2-41da-8949-836b31c53ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:31.757849 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa4e03-edb2-41da-8949-836b31c53ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:31.767681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa4e03-edb2-41da-8949-836b31c53ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:31.769142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa4e03-edb2-41da-8949-836b31c53ef6 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:31.779887 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1379/2766] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:38:32.284212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70658079-2c8f-41c2-ad80-2b1db523d913 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:32.290734 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-70658079-2c8f-41c2-ad80-2b1db523d913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:32.300388 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70658079-2c8f-41c2-ad80-2b1db523d913 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:32.306322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:32.307252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:32.307544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:32.307822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] PATH_INFO: `/v3/projects/7265d2c3d546447a9d97128a8abd1f23` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:32.310433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7265d2c3d546447a9d97128a8abd1f23)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:32.312626 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:32.443762 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7265d2c3d546447a9d97128a8abd1f23', 'request_id': 'req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:32.539613 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7265d2c3d546447a9d97128a8abd1f23', 'request_id': 'req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:32.548075 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7265d2c3d546447a9d97128a8abd1f23', 'request_id': 'req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:32.560822 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] The token cache is being invalidate because project 7265d2c3d546447a9d97128a8abd1f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:38:32.561261 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:32.562010 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:32.563631 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1388/2767] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:38:32 2022] DELETE /identity/v3/projects/7265d2c3d546447a9d97128a8abd1f23 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:32.579858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa4e03-edb2-41da-8949-836b31c53ef6 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:32.579858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa4e03-edb2-41da-8949-836b31c53ef6 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:32.647417 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00774f47-3de0-42e1-90da-8a5a8b29142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:32.648329 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00774f47-3de0-42e1-90da-8a5a8b29142f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:32.648615 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00774f47-3de0-42e1-90da-8a5a8b29142f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:32.648895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00774f47-3de0-42e1-90da-8a5a8b29142f admin admin] PATH_INFO: `/v3/users/e17004426676433aa6b0104d50ed6435` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:32.650976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00774f47-3de0-42e1-90da-8a5a8b29142f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17004426676433aa6b0104d50ed6435)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:32.653094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00774f47-3de0-42e1-90da-8a5a8b29142f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:32.841894 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-00774f47-3de0-42e1-90da-8a5a8b29142f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17004426676433aa6b0104d50ed6435'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:32.856182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-00774f47-3de0-42e1-90da-8a5a8b29142f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17004426676433aa6b0104d50ed6435'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:32.933698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-00774f47-3de0-42e1-90da-8a5a8b29142f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17004426676433aa6b0104d50ed6435'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:32.942584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-00774f47-3de0-42e1-90da-8a5a8b29142f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17004426676433aa6b0104d50ed6435'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:32.943650 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-00774f47-3de0-42e1-90da-8a5a8b29142f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17004426676433aa6b0104d50ed6435'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:32.951669 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1380/2768] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:38:32 2022] DELETE /identity/v3/users/e17004426676433aa6b0104d50ed6435 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:33.525537 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:33.527453 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:33.544651 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd53e1d-61d0-4f55-ab6b-6f5627dd5bee admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:33.618977 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:33.627581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:33.627581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:33.627581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] PATH_INFO: `/v3/projects/4a471c7291f4408db8ba68057d9d6c2f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:33.627581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a471c7291f4408db8ba68057d9d6c2f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:33.627581 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:33.835185 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a471c7291f4408db8ba68057d9d6c2f', 'request_id': 'req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:33.904948 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a471c7291f4408db8ba68057d9d6c2f', 'request_id': 'req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:33.912186 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a471c7291f4408db8ba68057d9d6c2f', 'request_id': 'req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:33.923765 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] The token cache is being invalidate because project 4a471c7291f4408db8ba68057d9d6c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:38:33.924052 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:33.924721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9a9ad6e8-3786-4b15-bf8a-63f7e49035ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:33.926321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1389/2769] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:38:33 2022] DELETE /identity/v3/projects/4a471c7291f4408db8ba68057d9d6c2f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:33.934105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0fed-e241-48e6-9f97-0e341e96f890 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:33.934987 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0fed-e241-48e6-9f97-0e341e96f890 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:33.935177 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0fed-e241-48e6-9f97-0e341e96f890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:33.955499 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7c4e0fed-e241-48e6-9f97-0e341e96f890 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:33.956926 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7c4e0fed-e241-48e6-9f97-0e341e96f890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:34.030308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1381/2770] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:34.038594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd09993-0626-4a4b-b257-074844d9acc8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:34.038871 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd09993-0626-4a4b-b257-074844d9acc8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:34.039134 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd09993-0626-4a4b-b257-074844d9acc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:34.060296 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fdd09993-0626-4a4b-b257-074844d9acc8 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:34.061723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fdd09993-0626-4a4b-b257-074844d9acc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:34.070668 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1390/2771] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:34.076158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e0fed-e241-48e6-9f97-0e341e96f890 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:34.087185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e0fed-e241-48e6-9f97-0e341e96f890 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:34.092289 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ae3ab-5b7e-47e3-b1d5-e515bd79ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:34.093016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ae3ab-5b7e-47e3-b1d5-e515bd79ede6 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:34.093410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ae3ab-5b7e-47e3-b1d5-e515bd79ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:34.093688 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ae3ab-5b7e-47e3-b1d5-e515bd79ede6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:34.094458 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ae3ab-5b7e-47e3-b1d5-e515bd79ede6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:38:34.094773 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ae3ab-5b7e-47e3-b1d5-e515bd79ede6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:34.096452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ae3ab-5b7e-47e3-b1d5-e515bd79ede6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:34.109554 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1382/2772] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:38:34.114327 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd09993-0626-4a4b-b257-074844d9acc8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:34.125555 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd09993-0626-4a4b-b257-074844d9acc8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:34.130710 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7a45c-6a10-426a-9f20-cca5683a5437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:34.131486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a45c-6a10-426a-9f20-cca5683a5437 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:34.131817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a45c-6a10-426a-9f20-cca5683a5437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:34.132143 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a45c-6a10-426a-9f20-cca5683a5437 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:34.132910 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7a45c-6a10-426a-9f20-cca5683a5437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:34.135843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7a45c-6a10-426a-9f20-cca5683a5437 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:34.244721 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1391/2773] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:38:34 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:38:34.249465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ae3ab-5b7e-47e3-b1d5-e515bd79ede6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:34.262277 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ae3ab-5b7e-47e3-b1d5-e515bd79ede6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:34.325313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb624-adbf-40bd-9430-1d08ef4aa0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:34.326045 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb624-adbf-40bd-9430-1d08ef4aa0ab admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:34.326367 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb624-adbf-40bd-9430-1d08ef4aa0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:34.326682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb624-adbf-40bd-9430-1d08ef4aa0ab admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:34.327456 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efb624-adbf-40bd-9430-1d08ef4aa0ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:34.329742 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efb624-adbf-40bd-9430-1d08ef4aa0ab admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:34.409766 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1383/2774] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:38:34 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:38:34.413376 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7a45c-6a10-426a-9f20-cca5683a5437 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:34.424618 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7a45c-6a10-426a-9f20-cca5683a5437 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:34.429483 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b1e74-d557-43c2-b301-3cdcca43850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:34.430165 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b1e74-d557-43c2-b301-3cdcca43850a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:34.430493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b1e74-d557-43c2-b301-3cdcca43850a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:34.430771 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b1e74-d557-43c2-b301-3cdcca43850a admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:34.431513 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b1e74-d557-43c2-b301-3cdcca43850a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:34.433815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b1e74-d557-43c2-b301-3cdcca43850a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:34.445482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1392/2775] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:38:34.452354 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb624-adbf-40bd-9430-1d08ef4aa0ab admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:34.463925 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb624-adbf-40bd-9430-1d08ef4aa0ab admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:34.468724 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513243e0-06c6-4abb-afa5-9d150b04c0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:34.470284 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513243e0-06c6-4abb-afa5-9d150b04c0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:34.470698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513243e0-06c6-4abb-afa5-9d150b04c0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:34.471095 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513243e0-06c6-4abb-afa5-9d150b04c0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:34.472092 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513243e0-06c6-4abb-afa5-9d150b04c0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:34.473942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513243e0-06c6-4abb-afa5-9d150b04c0f8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:34.485888 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1384/2776] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:34.490174 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b1e74-d557-43c2-b301-3cdcca43850a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:34.501850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b1e74-d557-43c2-b301-3cdcca43850a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:34.506746 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570bc58-9737-42ed-b9d8-79c50a04942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:34.507691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570bc58-9737-42ed-b9d8-79c50a04942c admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:34.508006 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570bc58-9737-42ed-b9d8-79c50a04942c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:34.508331 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570bc58-9737-42ed-b9d8-79c50a04942c admin admin] PATH_INFO: `/v3/projects/62bbcc013d004ef995bf7e94c18598a4/users/4ee997075ad44c98b6417f372cbf7af5/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:34.525511 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570bc58-9737-42ed-b9d8-79c50a04942c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bbcc013d004ef995bf7e94c18598a4, user_id=4ee997075ad44c98b6417f372cbf7af5, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:34.528197 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570bc58-9737-42ed-b9d8-79c50a04942c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:34.609168 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1393/2777] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:34 2022] PUT /identity/v3/projects/62bbcc013d004ef995bf7e94c18598a4/users/4ee997075ad44c98b6417f372cbf7af5/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:34.620580 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f6331-cba6-42f1-8695-17cc4bb64f6c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:34.620912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f6331-cba6-42f1-8695-17cc4bb64f6c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:34.621175 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f6331-cba6-42f1-8695-17cc4bb64f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:34.649541 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3c9f6331-cba6-42f1-8695-17cc4bb64f6c None None] MFA Rules not processed for user `4ee997075ad44c98b6417f372cbf7af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:34.650889 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3c9f6331-cba6-42f1-8695-17cc4bb64f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:34.724385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1385/2778] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:34.730784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570bc58-9737-42ed-b9d8-79c50a04942c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:34.799528 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570bc58-9737-42ed-b9d8-79c50a04942c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:34.804905 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc5ee3-f8b4-44b2-89db-72b07e02b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:34.806041 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc5ee3-f8b4-44b2-89db-72b07e02b754 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:34.806369 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc5ee3-f8b4-44b2-89db-72b07e02b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:34.806701 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc5ee3-f8b4-44b2-89db-72b07e02b754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:34.807538 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc5ee3-f8b4-44b2-89db-72b07e02b754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:34.809828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc5ee3-f8b4-44b2-89db-72b07e02b754 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:34.931786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1394/2779] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:38:34 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:38:34.935832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f6331-cba6-42f1-8695-17cc4bb64f6c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:34.946990 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f6331-cba6-42f1-8695-17cc4bb64f6c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:35.011131 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc63da-660f-408c-a072-77ec222de31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:35.011832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc63da-660f-408c-a072-77ec222de31b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:35.012116 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc63da-660f-408c-a072-77ec222de31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:35.012393 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc63da-660f-408c-a072-77ec222de31b admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:35.013170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc63da-660f-408c-a072-77ec222de31b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:35.015221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc63da-660f-408c-a072-77ec222de31b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:35.099939 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1386/2780] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:38:34 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:38:35.105751 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc5ee3-f8b4-44b2-89db-72b07e02b754 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:35.124982 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc5ee3-f8b4-44b2-89db-72b07e02b754 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:35.132942 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744dbe2-61ab-4668-8518-23d1ad55879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:35.134660 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744dbe2-61ab-4668-8518-23d1ad55879f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:35.135130 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744dbe2-61ab-4668-8518-23d1ad55879f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:35.135646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744dbe2-61ab-4668-8518-23d1ad55879f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:35.137034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744dbe2-61ab-4668-8518-23d1ad55879f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:35.140097 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744dbe2-61ab-4668-8518-23d1ad55879f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:35.154448 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1395/2781] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:35.158899 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc63da-660f-408c-a072-77ec222de31b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:35.170324 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc63da-660f-408c-a072-77ec222de31b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:35.175197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f7d20-3ac1-46ea-98fa-4293ec436804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:35.176164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f7d20-3ac1-46ea-98fa-4293ec436804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:35.176442 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f7d20-3ac1-46ea-98fa-4293ec436804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:35.176715 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f7d20-3ac1-46ea-98fa-4293ec436804 admin admin] PATH_INFO: `/v3/projects/54cfab153b994a4189cef271821de453/users/e2c65f57e0764d2ea5b7777e9244f162/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:35.193703 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f7d20-3ac1-46ea-98fa-4293ec436804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cfab153b994a4189cef271821de453, user_id=e2c65f57e0764d2ea5b7777e9244f162, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:35.197480 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f7d20-3ac1-46ea-98fa-4293ec436804 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:35.300016 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1387/2782] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:35 2022] PUT /identity/v3/projects/54cfab153b994a4189cef271821de453/users/e2c65f57e0764d2ea5b7777e9244f162/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:38:35.304206 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744dbe2-61ab-4668-8518-23d1ad55879f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:35.315050 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744dbe2-61ab-4668-8518-23d1ad55879f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:35.381262 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7214595-a73d-4b00-adad-43f3a7db1b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:35.381934 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7214595-a73d-4b00-adad-43f3a7db1b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:35.382233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7214595-a73d-4b00-adad-43f3a7db1b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:35.382487 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7214595-a73d-4b00-adad-43f3a7db1b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:35.383219 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7214595-a73d-4b00-adad-43f3a7db1b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:35.385998 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7214595-a73d-4b00-adad-43f3a7db1b12 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:35.397529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1396/2783] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:38:35.402966 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f7d20-3ac1-46ea-98fa-4293ec436804 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:35.420303 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f7d20-3ac1-46ea-98fa-4293ec436804 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:35.427927 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e753a7-2dea-430d-a2c9-59d838276537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:35.429567 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e753a7-2dea-430d-a2c9-59d838276537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:35.430090 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e753a7-2dea-430d-a2c9-59d838276537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:35.430641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e753a7-2dea-430d-a2c9-59d838276537 admin admin] PATH_INFO: `/v3/projects/54cfab153b994a4189cef271821de453/users/e2c65f57e0764d2ea5b7777e9244f162/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:35.434124 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e753a7-2dea-430d-a2c9-59d838276537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cfab153b994a4189cef271821de453, user_id=e2c65f57e0764d2ea5b7777e9244f162, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:35.439618 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e753a7-2dea-430d-a2c9-59d838276537 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:35.456489 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1388/2784] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:35 2022] PUT /identity/v3/projects/54cfab153b994a4189cef271821de453/users/e2c65f57e0764d2ea5b7777e9244f162/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:38:35.478067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94c7c4-ce39-4d12-a443-6d10fe54fc1f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:35.478446 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94c7c4-ce39-4d12-a443-6d10fe54fc1f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:35.478895 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94c7c4-ce39-4d12-a443-6d10fe54fc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:35.513036 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5d94c7c4-ce39-4d12-a443-6d10fe54fc1f None None] MFA Rules not processed for user `e2c65f57e0764d2ea5b7777e9244f162`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:35.514444 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5d94c7c4-ce39-4d12-a443-6d10fe54fc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:35.593952 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1397/2785] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:35.607473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e753a7-2dea-430d-a2c9-59d838276537 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:35.609356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-08e753a7-2dea-430d-a2c9-59d838276537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:35.687226 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e753a7-2dea-430d-a2c9-59d838276537 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:35.691665 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3c3d1-5bca-4849-9ac3-0481b7ba6b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:35.692479 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3c3d1-5bca-4849-9ac3-0481b7ba6b95 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:35.692865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3c3d1-5bca-4849-9ac3-0481b7ba6b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:35.693280 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3c3d1-5bca-4849-9ac3-0481b7ba6b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:35.704877 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3c3d1-5bca-4849-9ac3-0481b7ba6b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:35.706358 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3c3d1-5bca-4849-9ac3-0481b7ba6b95 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:35.717647 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1389/2786] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:38:36.174120 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94c7c4-ce39-4d12-a443-6d10fe54fc1f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:36.184544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94c7c4-ce39-4d12-a443-6d10fe54fc1f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:36.188586 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7807ed6-c63f-4896-a847-9e50a978dcd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:36.189274 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7807ed6-c63f-4896-a847-9e50a978dcd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:36.189556 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7807ed6-c63f-4896-a847-9e50a978dcd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:36.189831 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7807ed6-c63f-4896-a847-9e50a978dcd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:36.266416 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7807ed6-c63f-4896-a847-9e50a978dcd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:36.268047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7807ed6-c63f-4896-a847-9e50a978dcd5 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:36.280110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1398/2787] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:38:40.089426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3c3d1-5bca-4849-9ac3-0481b7ba6b95 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:40.162859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3c3d1-5bca-4849-9ac3-0481b7ba6b95 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:40.167878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:40.168788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:40.169112 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:40.169397 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] PATH_INFO: `/v3/users/4ee997075ad44c98b6417f372cbf7af5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:40.170720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee997075ad44c98b6417f372cbf7af5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:40.172691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:40.418705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee997075ad44c98b6417f372cbf7af5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:40.433107 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee997075ad44c98b6417f372cbf7af5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:40.504079 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee997075ad44c98b6417f372cbf7af5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:40.512435 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee997075ad44c98b6417f372cbf7af5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:40.513239 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee997075ad44c98b6417f372cbf7af5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:40.520185 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1390/2788] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:38:40 2022] DELETE /identity/v3/users/4ee997075ad44c98b6417f372cbf7af5 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:38:40.525527 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9cd4f-5760-4b13-b353-64a98025490f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:40.526096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9cd4f-5760-4b13-b353-64a98025490f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:40.526096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9cd4f-5760-4b13-b353-64a98025490f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:40.546499 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-88c9cd4f-5760-4b13-b353-64a98025490f None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:40.547734 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-88c9cd4f-5760-4b13-b353-64a98025490f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:40.610968 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1399/2789] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:40.622180 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:40.623674 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:40.689376 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac3c4f-4417-4c77-9423-0b24525cad87 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:40.693084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc1f31-61f3-4e06-9beb-89ad5e20d0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:40.693755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc1f31-61f3-4e06-9beb-89ad5e20d0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:40.694050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc1f31-61f3-4e06-9beb-89ad5e20d0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:40.694330 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc1f31-61f3-4e06-9beb-89ad5e20d0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:40.704993 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc1f31-61f3-4e06-9beb-89ad5e20d0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:40.706454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc1f31-61f3-4e06-9beb-89ad5e20d0f1 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:40.717681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1391/2790] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:38:41.289557 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9cd4f-5760-4b13-b353-64a98025490f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:41.291790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-88c9cd4f-5760-4b13-b353-64a98025490f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:41.307833 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9cd4f-5760-4b13-b353-64a98025490f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:41.315242 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:41.315783 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:41.316292 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:41.316779 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] PATH_INFO: `/v3/projects/62bbcc013d004ef995bf7e94c18598a4` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:41.319016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62bbcc013d004ef995bf7e94c18598a4)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:41.324066 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:41.546262 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62bbcc013d004ef995bf7e94c18598a4', 'request_id': 'req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:41.687108 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62bbcc013d004ef995bf7e94c18598a4', 'request_id': 'req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:41.698922 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62bbcc013d004ef995bf7e94c18598a4', 'request_id': 'req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:41.710741 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] The token cache is being invalidate because project 62bbcc013d004ef995bf7e94c18598a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:38:41.711268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:41.712065 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:41.714224 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1400/2791] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:38:41 2022] DELETE /identity/v3/projects/62bbcc013d004ef995bf7e94c18598a4 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:38:41.718702 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc1f31-61f3-4e06-9beb-89ad5e20d0f1 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:41.728802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc1f31-61f3-4e06-9beb-89ad5e20d0f1 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:41.787646 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de8733-8c7b-4790-b3d6-6d5912dc2e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:41.788539 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de8733-8c7b-4790-b3d6-6d5912dc2e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:41.788825 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de8733-8c7b-4790-b3d6-6d5912dc2e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:41.789156 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de8733-8c7b-4790-b3d6-6d5912dc2e34 admin admin] PATH_INFO: `/v3/users/e2c65f57e0764d2ea5b7777e9244f162` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:41.790627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de8733-8c7b-4790-b3d6-6d5912dc2e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c65f57e0764d2ea5b7777e9244f162)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:41.792674 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de8733-8c7b-4790-b3d6-6d5912dc2e34 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:41.999854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-62de8733-8c7b-4790-b3d6-6d5912dc2e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c65f57e0764d2ea5b7777e9244f162'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:42.013502 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-62de8733-8c7b-4790-b3d6-6d5912dc2e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c65f57e0764d2ea5b7777e9244f162'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:42.099246 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-62de8733-8c7b-4790-b3d6-6d5912dc2e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c65f57e0764d2ea5b7777e9244f162'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:42.108102 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-62de8733-8c7b-4790-b3d6-6d5912dc2e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c65f57e0764d2ea5b7777e9244f162'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:42.108818 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-62de8733-8c7b-4790-b3d6-6d5912dc2e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c65f57e0764d2ea5b7777e9244f162'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:42.114955 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1392/2792] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:38:41 2022] DELETE /identity/v3/users/e2c65f57e0764d2ea5b7777e9244f162 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:42.632184 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:42.634828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:42.656500 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c92d3-d4de-4fbe-b346-21aaaba1d1f3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:42.724691 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:42.725591 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:42.725870 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:42.726136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] PATH_INFO: `/v3/projects/54cfab153b994a4189cef271821de453` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:42.728681 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54cfab153b994a4189cef271821de453)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:42.730637 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:42.855877 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54cfab153b994a4189cef271821de453', 'request_id': 'req-94955ae9-042c-4f8d-a769-487a6f74ea2c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:42.962909 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54cfab153b994a4189cef271821de453', 'request_id': 'req-94955ae9-042c-4f8d-a769-487a6f74ea2c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:42.974715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54cfab153b994a4189cef271821de453', 'request_id': 'req-94955ae9-042c-4f8d-a769-487a6f74ea2c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:42.993784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] The token cache is being invalidate because project 54cfab153b994a4189cef271821de453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:38:42.999295 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:42.999295 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-94955ae9-042c-4f8d-a769-487a6f74ea2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:42.999295 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1401/2793] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:38:42 2022] DELETE /identity/v3/projects/54cfab153b994a4189cef271821de453 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:43.003080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755514a0-6863-44cb-b5c6-e6ab9b2bb147 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:43.003858 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755514a0-6863-44cb-b5c6-e6ab9b2bb147 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:43.004076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755514a0-6863-44cb-b5c6-e6ab9b2bb147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:43.028536 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-755514a0-6863-44cb-b5c6-e6ab9b2bb147 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:43.029991 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-755514a0-6863-44cb-b5c6-e6ab9b2bb147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:43.091631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1393/2794] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:43.100094 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd4c25-77a6-4588-bf22-327a797c899d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:43.100377 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd4c25-77a6-4588-bf22-327a797c899d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:43.100654 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd4c25-77a6-4588-bf22-327a797c899d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:43.121092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-60cd4c25-77a6-4588-bf22-327a797c899d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:43.122307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-60cd4c25-77a6-4588-bf22-327a797c899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:43.130284 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1402/2795] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:43.134984 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755514a0-6863-44cb-b5c6-e6ab9b2bb147 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:43.144701 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755514a0-6863-44cb-b5c6-e6ab9b2bb147 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:43.150443 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759f9c-4734-4d25-bf8f-aaa30a1cc732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:43.151122 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759f9c-4734-4d25-bf8f-aaa30a1cc732 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:43.151405 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759f9c-4734-4d25-bf8f-aaa30a1cc732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:43.151678 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759f9c-4734-4d25-bf8f-aaa30a1cc732 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:43.152414 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d759f9c-4734-4d25-bf8f-aaa30a1cc732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:38:43.152718 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d759f9c-4734-4d25-bf8f-aaa30a1cc732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:43.154371 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d759f9c-4734-4d25-bf8f-aaa30a1cc732 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:43.168452 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1394/2796] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:38:43.173252 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd4c25-77a6-4588-bf22-327a797c899d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:43.183720 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd4c25-77a6-4588-bf22-327a797c899d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:43.189409 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53415b74-4b07-4a67-936a-f6fb334d30fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:43.190245 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415b74-4b07-4a67-936a-f6fb334d30fe admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:43.190603 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415b74-4b07-4a67-936a-f6fb334d30fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:43.190925 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415b74-4b07-4a67-936a-f6fb334d30fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:43.191688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53415b74-4b07-4a67-936a-f6fb334d30fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:43.194233 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53415b74-4b07-4a67-936a-f6fb334d30fe admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:43.330346 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1403/2797] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:38:43 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:38:43.336859 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759f9c-4734-4d25-bf8f-aaa30a1cc732 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:43.356295 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759f9c-4734-4d25-bf8f-aaa30a1cc732 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:43.424147 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b978912-afde-483a-88c7-2f05457d6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:43.424844 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b978912-afde-483a-88c7-2f05457d6e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:43.425159 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b978912-afde-483a-88c7-2f05457d6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:43.425433 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b978912-afde-483a-88c7-2f05457d6e92 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:43.426160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b978912-afde-483a-88c7-2f05457d6e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:43.428053 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b978912-afde-483a-88c7-2f05457d6e92 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:43.505840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1395/2798] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:38:43 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:38:43.511000 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53415b74-4b07-4a67-936a-f6fb334d30fe admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:43.521828 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53415b74-4b07-4a67-936a-f6fb334d30fe admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:43.527833 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0887c-d17d-4a3d-ade8-55bfda904f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:43.528647 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0887c-d17d-4a3d-ade8-55bfda904f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:43.529114 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0887c-d17d-4a3d-ade8-55bfda904f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:43.529504 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0887c-d17d-4a3d-ade8-55bfda904f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:43.530432 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0887c-d17d-4a3d-ade8-55bfda904f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:43.532218 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0887c-d17d-4a3d-ade8-55bfda904f6c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:43.543939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1404/2799] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:43.548527 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b978912-afde-483a-88c7-2f05457d6e92 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:43.559654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b978912-afde-483a-88c7-2f05457d6e92 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:43.564574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7340a5c-c88e-4a0f-8aa5-6d151694a44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:43.565282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340a5c-c88e-4a0f-8aa5-6d151694a44a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:43.565576 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340a5c-c88e-4a0f-8aa5-6d151694a44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:43.565854 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340a5c-c88e-4a0f-8aa5-6d151694a44a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:43.566591 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7340a5c-c88e-4a0f-8aa5-6d151694a44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:43.568234 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7340a5c-c88e-4a0f-8aa5-6d151694a44a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:43.580230 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1396/2800] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:43.584736 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0887c-d17d-4a3d-ade8-55bfda904f6c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:43.595984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0887c-d17d-4a3d-ade8-55bfda904f6c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:43.600845 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8a0d4-0aa9-4f79-9bf8-392cc1a5aa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:43.601829 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a0d4-0aa9-4f79-9bf8-392cc1a5aa36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:43.602105 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a0d4-0aa9-4f79-9bf8-392cc1a5aa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:43.602379 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a0d4-0aa9-4f79-9bf8-392cc1a5aa36 admin admin] PATH_INFO: `/v3/projects/b2a8ab228d4a44f7b1f5c960514f1273/users/06ec049ad55048aaa22502f1ef1b4198/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:43.618454 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a0d4-0aa9-4f79-9bf8-392cc1a5aa36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a8ab228d4a44f7b1f5c960514f1273, user_id=06ec049ad55048aaa22502f1ef1b4198, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:43.620754 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a0d4-0aa9-4f79-9bf8-392cc1a5aa36 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:43.701422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1405/2801] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:43 2022] PUT /identity/v3/projects/b2a8ab228d4a44f7b1f5c960514f1273/users/06ec049ad55048aaa22502f1ef1b4198/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:43.714692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560185-daa5-4035-a705-09c35adf8291 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:43.714692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560185-daa5-4035-a705-09c35adf8291 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:43.714692 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560185-daa5-4035-a705-09c35adf8291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:43.747389 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-22560185-daa5-4035-a705-09c35adf8291 None None] MFA Rules not processed for user `06ec049ad55048aaa22502f1ef1b4198`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:43.751954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-22560185-daa5-4035-a705-09c35adf8291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:43.830373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1397/2802] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:43.835406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8a0d4-0aa9-4f79-9bf8-392cc1a5aa36 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:43.909735 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8a0d4-0aa9-4f79-9bf8-392cc1a5aa36 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:43.915843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae9632-24da-4341-bcf2-984ba5aa0065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:43.917995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae9632-24da-4341-bcf2-984ba5aa0065 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:43.917995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae9632-24da-4341-bcf2-984ba5aa0065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:43.917995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae9632-24da-4341-bcf2-984ba5aa0065 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:43.917995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae9632-24da-4341-bcf2-984ba5aa0065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:43.919860 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae9632-24da-4341-bcf2-984ba5aa0065 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:44.028189 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1406/2803] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:38:43 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:38:44.033068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22560185-daa5-4035-a705-09c35adf8291 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:44.047705 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22560185-daa5-4035-a705-09c35adf8291 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:44.109728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adc31f-c137-4f0c-bdcf-2493626a27ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:44.110477 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adc31f-c137-4f0c-bdcf-2493626a27ee admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:44.110851 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adc31f-c137-4f0c-bdcf-2493626a27ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:44.111242 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adc31f-c137-4f0c-bdcf-2493626a27ee admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:44.112035 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adc31f-c137-4f0c-bdcf-2493626a27ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:44.114094 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adc31f-c137-4f0c-bdcf-2493626a27ee admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:44.231282 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1398/2804] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:38:44 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:38:44.235628 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae9632-24da-4341-bcf2-984ba5aa0065 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:44.246623 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae9632-24da-4341-bcf2-984ba5aa0065 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:44.251493 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6737813-065b-49ba-88c1-60f83d91b6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:44.252322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737813-065b-49ba-88c1-60f83d91b6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:44.252489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737813-065b-49ba-88c1-60f83d91b6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:44.252759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737813-065b-49ba-88c1-60f83d91b6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:44.253536 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6737813-065b-49ba-88c1-60f83d91b6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:44.255165 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6737813-065b-49ba-88c1-60f83d91b6ee admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:44.267944 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1407/2805] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:44.275632 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adc31f-c137-4f0c-bdcf-2493626a27ee admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:44.286517 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adc31f-c137-4f0c-bdcf-2493626a27ee admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:44.291559 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f733b9-94c9-47a8-9397-af11d6681ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:44.292460 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f733b9-94c9-47a8-9397-af11d6681ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:44.292740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f733b9-94c9-47a8-9397-af11d6681ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:44.293044 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f733b9-94c9-47a8-9397-af11d6681ffd admin admin] PATH_INFO: `/v3/projects/4c7900df89a745bfb954cdad85092a4d/users/5abeb7cd5a334a00a8927fc3890fa8d3/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:44.308878 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f733b9-94c9-47a8-9397-af11d6681ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7900df89a745bfb954cdad85092a4d, user_id=5abeb7cd5a334a00a8927fc3890fa8d3, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:44.311769 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f733b9-94c9-47a8-9397-af11d6681ffd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:44.448438 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1399/2806] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:44 2022] PUT /identity/v3/projects/4c7900df89a745bfb954cdad85092a4d/users/5abeb7cd5a334a00a8927fc3890fa8d3/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:44.452688 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6737813-065b-49ba-88c1-60f83d91b6ee admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:44.464412 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6737813-065b-49ba-88c1-60f83d91b6ee admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:44.522646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826e704-1488-4f0a-a4ec-e82566660bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:44.523316 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e704-1488-4f0a-a4ec-e82566660bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:44.524230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e704-1488-4f0a-a4ec-e82566660bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:44.524521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e704-1488-4f0a-a4ec-e82566660bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:44.525335 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826e704-1488-4f0a-a4ec-e82566660bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:44.526957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826e704-1488-4f0a-a4ec-e82566660bdf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:44.537700 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1408/2807] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:44.542459 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f733b9-94c9-47a8-9397-af11d6681ffd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:44.553683 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f733b9-94c9-47a8-9397-af11d6681ffd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:44.559412 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704eaa-c0e9-4be4-b74b-3fbbc704f246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:44.560368 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704eaa-c0e9-4be4-b74b-3fbbc704f246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:44.560648 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704eaa-c0e9-4be4-b74b-3fbbc704f246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:44.561039 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704eaa-c0e9-4be4-b74b-3fbbc704f246 admin admin] PATH_INFO: `/v3/projects/4c7900df89a745bfb954cdad85092a4d/users/5abeb7cd5a334a00a8927fc3890fa8d3/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:44.563243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704eaa-c0e9-4be4-b74b-3fbbc704f246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7900df89a745bfb954cdad85092a4d, user_id=5abeb7cd5a334a00a8927fc3890fa8d3, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:44.566032 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704eaa-c0e9-4be4-b74b-3fbbc704f246 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:44.578691 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1400/2808] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:44 2022] PUT /identity/v3/projects/4c7900df89a745bfb954cdad85092a4d/users/5abeb7cd5a334a00a8927fc3890fa8d3/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:44.590530 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232bd1-c854-4ef6-85a2-c38dc1d57137 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:44.590819 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232bd1-c854-4ef6-85a2-c38dc1d57137 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:44.591093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232bd1-c854-4ef6-85a2-c38dc1d57137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:44.618964 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-41232bd1-c854-4ef6-85a2-c38dc1d57137 None None] MFA Rules not processed for user `5abeb7cd5a334a00a8927fc3890fa8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:44.620192 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-41232bd1-c854-4ef6-85a2-c38dc1d57137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:44.698411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1409/2809] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:44.710253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704eaa-c0e9-4be4-b74b-3fbbc704f246 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:44.712928 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5e704eaa-c0e9-4be4-b74b-3fbbc704f246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:44.778572 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704eaa-c0e9-4be4-b74b-3fbbc704f246 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:44.783410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbedb3-70a9-4420-843d-5710cb246279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:44.784080 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbedb3-70a9-4420-843d-5710cb246279 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:44.784360 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbedb3-70a9-4420-843d-5710cb246279 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:44.784635 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbedb3-70a9-4420-843d-5710cb246279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:44.795149 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbedb3-70a9-4420-843d-5710cb246279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:44.796609 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbedb3-70a9-4420-843d-5710cb246279 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:44.808520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1401/2810] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:38:44.914898 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41232bd1-c854-4ef6-85a2-c38dc1d57137 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:44.925221 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41232bd1-c854-4ef6-85a2-c38dc1d57137 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:44.929104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05739dd7-6e6a-4551-8e40-6cfe9142136f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:44.929810 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05739dd7-6e6a-4551-8e40-6cfe9142136f service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:44.930092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05739dd7-6e6a-4551-8e40-6cfe9142136f service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:44.930363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05739dd7-6e6a-4551-8e40-6cfe9142136f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:44.990784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05739dd7-6e6a-4551-8e40-6cfe9142136f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:44.992136 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05739dd7-6e6a-4551-8e40-6cfe9142136f service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:45.002653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1410/2811] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:38:48.459356 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbedb3-70a9-4420-843d-5710cb246279 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:48.538062 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbedb3-70a9-4420-843d-5710cb246279 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:48.545311 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:48.546571 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:48.546963 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:48.547351 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] PATH_INFO: `/v3/users/06ec049ad55048aaa22502f1ef1b4198` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:48.548725 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ec049ad55048aaa22502f1ef1b4198)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:48.551675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:48.793601 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ec049ad55048aaa22502f1ef1b4198'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:48.807337 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ec049ad55048aaa22502f1ef1b4198'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:48.956529 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ec049ad55048aaa22502f1ef1b4198'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:48.966461 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ec049ad55048aaa22502f1ef1b4198'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:48.967182 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ec049ad55048aaa22502f1ef1b4198'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:48.973565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1402/2812] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:38:48 2022] DELETE /identity/v3/users/06ec049ad55048aaa22502f1ef1b4198 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:48.978603 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e7553-6589-44db-b59f-fd3037c961c8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:48.979215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e7553-6589-44db-b59f-fd3037c961c8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:48.979215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e7553-6589-44db-b59f-fd3037c961c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:48.999171 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-153e7553-6589-44db-b59f-fd3037c961c8 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:49.000509 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-153e7553-6589-44db-b59f-fd3037c961c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:49.066117 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1411/2813] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:49.077355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:49.079153 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:49.138526 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a7d5b-f3a1-41cc-a8e8-30e792b1dd40 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:49.142121 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328765b-beef-4f59-ba3c-cf0bdbb08c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:49.142782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328765b-beef-4f59-ba3c-cf0bdbb08c3b service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:49.143038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328765b-beef-4f59-ba3c-cf0bdbb08c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:49.143308 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328765b-beef-4f59-ba3c-cf0bdbb08c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:49.153958 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328765b-beef-4f59-ba3c-cf0bdbb08c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:49.155388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328765b-beef-4f59-ba3c-cf0bdbb08c3b service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:49.165902 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1403/2814] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:38:49.702076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e7553-6589-44db-b59f-fd3037c961c8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:49.702076 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-153e7553-6589-44db-b59f-fd3037c961c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:49.837237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328765b-beef-4f59-ba3c-cf0bdbb08c3b service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:49.838698 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8328765b-beef-4f59-ba3c-cf0bdbb08c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:49.856639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328765b-beef-4f59-ba3c-cf0bdbb08c3b service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:49.858714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e7553-6589-44db-b59f-fd3037c961c8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:49.863677 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:49.864592 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:49.864871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:49.865364 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] PATH_INFO: `/v3/projects/b2a8ab228d4a44f7b1f5c960514f1273` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:49.865579 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f119f-94ff-4589-bdd0-9e28ed596208 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7095f3ab8545c589d4d28a846ba1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:49.866641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a8ab228d4a44f7b1f5c960514f1273)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:49.866874 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f119f-94ff-4589-bdd0-9e28ed596208 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:49.867489 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f119f-94ff-4589-bdd0-9e28ed596208 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:49.868072 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f119f-94ff-4589-bdd0-9e28ed596208 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:49.869916 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:49.879595 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d95f119f-94ff-4589-bdd0-9e28ed596208 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:49.891921 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f119f-94ff-4589-bdd0-9e28ed596208 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:49.895065 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f119f-94ff-4589-bdd0-9e28ed596208 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:49.909222 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1412/2815] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:38:50.066488 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a8ab228d4a44f7b1f5c960514f1273', 'request_id': 'req-66362989-79f5-4588-8c1c-d6ddef98920b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:50.213581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a8ab228d4a44f7b1f5c960514f1273', 'request_id': 'req-66362989-79f5-4588-8c1c-d6ddef98920b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:50.221574 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a8ab228d4a44f7b1f5c960514f1273', 'request_id': 'req-66362989-79f5-4588-8c1c-d6ddef98920b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:50.233314 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] The token cache is being invalidate because project b2a8ab228d4a44f7b1f5c960514f1273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:38:50.233655 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:50.234469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:50.236171 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1404/2816] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:38:49 2022] DELETE /identity/v3/projects/b2a8ab228d4a44f7b1f5c960514f1273 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:50.240602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f119f-94ff-4589-bdd0-9e28ed596208 service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:50.251816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f119f-94ff-4589-bdd0-9e28ed596208 service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:50.330357 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131ce76-1e6f-4e1a-9a95-5ae69ef3cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:50.331248 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ce76-1e6f-4e1a-9a95-5ae69ef3cf9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:50.331531 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ce76-1e6f-4e1a-9a95-5ae69ef3cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:50.331806 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ce76-1e6f-4e1a-9a95-5ae69ef3cf9c admin admin] PATH_INFO: `/v3/users/5abeb7cd5a334a00a8927fc3890fa8d3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:50.333104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131ce76-1e6f-4e1a-9a95-5ae69ef3cf9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5abeb7cd5a334a00a8927fc3890fa8d3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:50.335182 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131ce76-1e6f-4e1a-9a95-5ae69ef3cf9c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:50.610228 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3131ce76-1e6f-4e1a-9a95-5ae69ef3cf9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5abeb7cd5a334a00a8927fc3890fa8d3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:50.623575 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3131ce76-1e6f-4e1a-9a95-5ae69ef3cf9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5abeb7cd5a334a00a8927fc3890fa8d3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:50.624485 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3131ce76-1e6f-4e1a-9a95-5ae69ef3cf9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5abeb7cd5a334a00a8927fc3890fa8d3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:50.632360 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3131ce76-1e6f-4e1a-9a95-5ae69ef3cf9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5abeb7cd5a334a00a8927fc3890fa8d3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:50.633714 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3131ce76-1e6f-4e1a-9a95-5ae69ef3cf9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5abeb7cd5a334a00a8927fc3890fa8d3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:50.785529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1413/2817] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:38:50 2022] DELETE /identity/v3/users/5abeb7cd5a334a00a8927fc3890fa8d3 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:51.497868 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:51.500524 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:51.527542 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66362989-79f5-4588-8c1c-d6ddef98920b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:51.596905 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:51.597801 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:51.598087 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:51.598366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] PATH_INFO: `/v3/projects/4c7900df89a745bfb954cdad85092a4d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:51.599640 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7900df89a745bfb954cdad85092a4d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:51.602491 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:51.763387 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7900df89a745bfb954cdad85092a4d', 'request_id': 'req-ce066b0c-b011-4c30-b8aa-529040dc2bcd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:51.864632 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7900df89a745bfb954cdad85092a4d', 'request_id': 'req-ce066b0c-b011-4c30-b8aa-529040dc2bcd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:51.872506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7900df89a745bfb954cdad85092a4d', 'request_id': 'req-ce066b0c-b011-4c30-b8aa-529040dc2bcd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:51.885274 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] The token cache is being invalidate because project 4c7900df89a745bfb954cdad85092a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:38:51.885707 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:51.886388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ce066b0c-b011-4c30-b8aa-529040dc2bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:38:51.888003 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1405/2818] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:38:51 2022] DELETE /identity/v3/projects/4c7900df89a745bfb954cdad85092a4d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:51.893652 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd4a6-ba09-414c-a9c1-d289afdcc1f6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:51.894275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd4a6-ba09-414c-a9c1-d289afdcc1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:51.894275 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd4a6-ba09-414c-a9c1-d289afdcc1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:51.918408 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5c8fd4a6-ba09-414c-a9c1-d289afdcc1f6 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:51.920096 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5c8fd4a6-ba09-414c-a9c1-d289afdcc1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:51.985314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1414/2819] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:51.994058 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34bfc0-c06d-424f-99b7-fa3149d71115 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:51.994374 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34bfc0-c06d-424f-99b7-fa3149d71115 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:51.994676 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34bfc0-c06d-424f-99b7-fa3149d71115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:52.015086 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ce34bfc0-c06d-424f-99b7-fa3149d71115 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:52.016288 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ce34bfc0-c06d-424f-99b7-fa3149d71115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:52.025966 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1406/2820] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:38:52.032990 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fd4a6-ba09-414c-a9c1-d289afdcc1f6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:52.050572 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fd4a6-ba09-414c-a9c1-d289afdcc1f6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:52.057687 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001105e-1c32-4f11-8c54-328026ef0fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:52.058392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001105e-1c32-4f11-8c54-328026ef0fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:52.058694 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001105e-1c32-4f11-8c54-328026ef0fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:52.058968 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001105e-1c32-4f11-8c54-328026ef0fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:52.059709 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001105e-1c32-4f11-8c54-328026ef0fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:38:52.060018 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001105e-1c32-4f11-8c54-328026ef0fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:52.061683 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001105e-1c32-4f11-8c54-328026ef0fbc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:52.074687 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1415/2821] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:38:52.080128 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34bfc0-c06d-424f-99b7-fa3149d71115 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:52.090431 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34bfc0-c06d-424f-99b7-fa3149d71115 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:52.095513 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fa0a5-81f9-45be-a54a-66b77f0ac296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:52.096170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fa0a5-81f9-45be-a54a-66b77f0ac296 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:52.096445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fa0a5-81f9-45be-a54a-66b77f0ac296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:52.096713 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fa0a5-81f9-45be-a54a-66b77f0ac296 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:52.097445 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fa0a5-81f9-45be-a54a-66b77f0ac296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:52.099344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fa0a5-81f9-45be-a54a-66b77f0ac296 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:52.204694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1407/2822] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:38:52 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:38:52.211941 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001105e-1c32-4f11-8c54-328026ef0fbc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:52.229309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001105e-1c32-4f11-8c54-328026ef0fbc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:52.299495 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c3e29-24d5-4ddb-bf72-14b367bc0696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:52.300091 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3e29-24d5-4ddb-bf72-14b367bc0696 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:52.300375 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3e29-24d5-4ddb-bf72-14b367bc0696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:52.300652 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3e29-24d5-4ddb-bf72-14b367bc0696 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:52.301421 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c3e29-24d5-4ddb-bf72-14b367bc0696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:52.303396 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c3e29-24d5-4ddb-bf72-14b367bc0696 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:52.488055 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1416/2823] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:38:52 2022] POST /identity/v3/users => generated 287 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:38:52.494111 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fa0a5-81f9-45be-a54a-66b77f0ac296 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:52.507010 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fa0a5-81f9-45be-a54a-66b77f0ac296 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:52.513298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a84ede-67e8-406f-9086-8cbd4fb0a107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:52.514049 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84ede-67e8-406f-9086-8cbd4fb0a107 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:52.514415 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84ede-67e8-406f-9086-8cbd4fb0a107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:52.514833 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84ede-67e8-406f-9086-8cbd4fb0a107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:52.515716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a84ede-67e8-406f-9086-8cbd4fb0a107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:52.517658 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a84ede-67e8-406f-9086-8cbd4fb0a107 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:52.532126 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1408/2824] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:52.537201 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c3e29-24d5-4ddb-bf72-14b367bc0696 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:52.556768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c3e29-24d5-4ddb-bf72-14b367bc0696 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:52.565850 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bda4a-6fe6-4855-bd44-129276e66f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:52.567014 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bda4a-6fe6-4855-bd44-129276e66f0d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:52.567732 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bda4a-6fe6-4855-bd44-129276e66f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:52.568232 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bda4a-6fe6-4855-bd44-129276e66f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:52.569730 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bda4a-6fe6-4855-bd44-129276e66f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:52.573084 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bda4a-6fe6-4855-bd44-129276e66f0d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:52.593653 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1417/2825] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:52.599286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a84ede-67e8-406f-9086-8cbd4fb0a107 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:52.618589 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a84ede-67e8-406f-9086-8cbd4fb0a107 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:52.626695 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7cb9a-5304-41a0-ab42-49a227c9307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:52.628287 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7cb9a-5304-41a0-ab42-49a227c9307e admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:52.628805 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7cb9a-5304-41a0-ab42-49a227c9307e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:52.629346 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7cb9a-5304-41a0-ab42-49a227c9307e admin admin] PATH_INFO: `/v3/projects/afd76447480d46cfb9524aec094e512c/users/fe55bda7d47447df90456d594cbece79/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:52.648936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7cb9a-5304-41a0-ab42-49a227c9307e admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd76447480d46cfb9524aec094e512c, user_id=fe55bda7d47447df90456d594cbece79, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:52.651840 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7cb9a-5304-41a0-ab42-49a227c9307e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:52.767046 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1409/2826] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:52 2022] PUT /identity/v3/projects/afd76447480d46cfb9524aec094e512c/users/fe55bda7d47447df90456d594cbece79/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:52.772747 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceb189-8d18-420d-85f9-b7ac80db6b3d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:52.773986 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceb189-8d18-420d-85f9-b7ac80db6b3d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:52.774885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceb189-8d18-420d-85f9-b7ac80db6b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:52.804482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4dceb189-8d18-420d-85f9-b7ac80db6b3d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:52.806756 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4dceb189-8d18-420d-85f9-b7ac80db6b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:52.894340 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1418/2827] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:52.905829 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7cb9a-5304-41a0-ab42-49a227c9307e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:52.907741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ae7cb9a-5304-41a0-ab42-49a227c9307e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:52.969233 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7cb9a-5304-41a0-ab42-49a227c9307e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:52.973120 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359094a8-ad62-48d4-a920-9054bdd40a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:52.973783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359094a8-ad62-48d4-a920-9054bdd40a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:52.974073 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359094a8-ad62-48d4-a920-9054bdd40a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:52.974339 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359094a8-ad62-48d4-a920-9054bdd40a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:52.985054 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359094a8-ad62-48d4-a920-9054bdd40a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:52.986626 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359094a8-ad62-48d4-a920-9054bdd40a53 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:52.997391 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1410/2828] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:38:55.148210 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabb0e0-5582-4d7d-a0e6-9b28ec82f639 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:55.149200 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabb0e0-5582-4d7d-a0e6-9b28ec82f639 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:55.149200 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabb0e0-5582-4d7d-a0e6-9b28ec82f639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:55.180115 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8aabb0e0-5582-4d7d-a0e6-9b28ec82f639 None None] MFA Rules not processed for user `fe55bda7d47447df90456d594cbece79`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:55.181897 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8aabb0e0-5582-4d7d-a0e6-9b28ec82f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:55.255563 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1419/2829] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:38:55.261639 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359094a8-ad62-48d4-a920-9054bdd40a53 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:55.271865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359094a8-ad62-48d4-a920-9054bdd40a53 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:55.277521 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56d8d4-6f86-4adb-9e6b-4c9fa1e4d663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:55.278197 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56d8d4-6f86-4adb-9e6b-4c9fa1e4d663 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:55.278478 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56d8d4-6f86-4adb-9e6b-4c9fa1e4d663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:55.278755 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56d8d4-6f86-4adb-9e6b-4c9fa1e4d663 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:55.279466 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56d8d4-6f86-4adb-9e6b-4c9fa1e4d663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:55.281493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56d8d4-6f86-4adb-9e6b-4c9fa1e4d663 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:55.418050 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1411/2830] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:38:55 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:38:55.422460 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabb0e0-5582-4d7d-a0e6-9b28ec82f639 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:55.440641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabb0e0-5582-4d7d-a0e6-9b28ec82f639 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:55.510026 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50835758-b715-4865-8227-ea6794abeaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:55.510699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835758-b715-4865-8227-ea6794abeaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:55.511101 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835758-b715-4865-8227-ea6794abeaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:55.511325 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835758-b715-4865-8227-ea6794abeaa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:55.512063 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50835758-b715-4865-8227-ea6794abeaa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:55.514193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50835758-b715-4865-8227-ea6794abeaa4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:55.614262 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1420/2831] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:38:55 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 14:38:55.619385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56d8d4-6f86-4adb-9e6b-4c9fa1e4d663 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:55.630886 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56d8d4-6f86-4adb-9e6b-4c9fa1e4d663 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:55.636884 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77225056-26d5-4922-a33d-39061916587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:55.637614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225056-26d5-4922-a33d-39061916587d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:55.637895 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225056-26d5-4922-a33d-39061916587d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:55.638169 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225056-26d5-4922-a33d-39061916587d admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:55.638923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77225056-26d5-4922-a33d-39061916587d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:55.640583 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77225056-26d5-4922-a33d-39061916587d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:55.653899 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1412/2832] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:55.658807 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50835758-b715-4865-8227-ea6794abeaa4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:55.670763 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50835758-b715-4865-8227-ea6794abeaa4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:55.676243 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ece74-3ceb-4428-a196-3150503e6b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:55.677885 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ece74-3ceb-4428-a196-3150503e6b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:55.678318 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ece74-3ceb-4428-a196-3150503e6b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:55.678748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ece74-3ceb-4428-a196-3150503e6b7b admin admin] PATH_INFO: `/v3/projects/9e10c23fb46a4c4898a965e312cd44c6/users/1782bfb79eb943988db4e78e841cb036/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:55.705853 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ece74-3ceb-4428-a196-3150503e6b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e10c23fb46a4c4898a965e312cd44c6, user_id=1782bfb79eb943988db4e78e841cb036, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:55.710883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ece74-3ceb-4428-a196-3150503e6b7b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:55.837479 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1421/2833] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:55 2022] PUT /identity/v3/projects/9e10c23fb46a4c4898a965e312cd44c6/users/1782bfb79eb943988db4e78e841cb036/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:38:55.841839 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77225056-26d5-4922-a33d-39061916587d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:55.853253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77225056-26d5-4922-a33d-39061916587d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:55.918780 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebed28-3d8d-47d1-b7a0-c016cb642d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:55.919455 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebed28-3d8d-47d1-b7a0-c016cb642d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:55.919734 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebed28-3d8d-47d1-b7a0-c016cb642d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:55.920007 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebed28-3d8d-47d1-b7a0-c016cb642d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:55.920730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebed28-3d8d-47d1-b7a0-c016cb642d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:55.922392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebed28-3d8d-47d1-b7a0-c016cb642d85 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:55.933475 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1413/2834] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:38:55.938223 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ece74-3ceb-4428-a196-3150503e6b7b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:55.948894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ece74-3ceb-4428-a196-3150503e6b7b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:55.955983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff3e3f-ca75-47d3-842c-63fbcac1a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:55.955983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3e3f-ca75-47d3-842c-63fbcac1a4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:55.955983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3e3f-ca75-47d3-842c-63fbcac1a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:55.955983 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3e3f-ca75-47d3-842c-63fbcac1a4cd admin admin] PATH_INFO: `/v3/projects/9e10c23fb46a4c4898a965e312cd44c6/users/1782bfb79eb943988db4e78e841cb036/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:55.957601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff3e3f-ca75-47d3-842c-63fbcac1a4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e10c23fb46a4c4898a965e312cd44c6, user_id=1782bfb79eb943988db4e78e841cb036, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:55.960294 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff3e3f-ca75-47d3-842c-63fbcac1a4cd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:55.972451 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1422/2835] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:38:55 2022] PUT /identity/v3/projects/9e10c23fb46a4c4898a965e312cd44c6/users/1782bfb79eb943988db4e78e841cb036/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:38:57.784059 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b49e3-2e2f-41b2-bd7e-2d14ef96fc68 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:57.785000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b49e3-2e2f-41b2-bd7e-2d14ef96fc68 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:57.785000 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b49e3-2e2f-41b2-bd7e-2d14ef96fc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:57.818663 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-540b49e3-2e2f-41b2-bd7e-2d14ef96fc68 None None] MFA Rules not processed for user `1782bfb79eb943988db4e78e841cb036`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:38:57.819952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-540b49e3-2e2f-41b2-bd7e-2d14ef96fc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:57.906788 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1414/2836] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:38:57.920442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff3e3f-ca75-47d3-842c-63fbcac1a4cd admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:38:57.923301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-92ff3e3f-ca75-47d3-842c-63fbcac1a4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:38:57.995131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff3e3f-ca75-47d3-842c-63fbcac1a4cd admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:38:57.998894 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423224d3-1b3c-49ab-9f49-120209985bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:38:57.999540 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423224d3-1b3c-49ab-9f49-120209985bba service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:38:57.999848 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423224d3-1b3c-49ab-9f49-120209985bba service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:38:58.000119 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423224d3-1b3c-49ab-9f49-120209985bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:38:58.061867 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423224d3-1b3c-49ab-9f49-120209985bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:38:58.063401 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423224d3-1b3c-49ab-9f49-120209985bba service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:38:58.074809 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1423/2837] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:38:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 14:39:00.168782 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b49e3-2e2f-41b2-bd7e-2d14ef96fc68 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:00.171158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-540b49e3-2e2f-41b2-bd7e-2d14ef96fc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:00.191704 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b49e3-2e2f-41b2-bd7e-2d14ef96fc68 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:00.197871 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b88f98-cc00-4621-922f-bb4f6e08096c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:00.198982 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b88f98-cc00-4621-922f-bb4f6e08096c service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:00.199493 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b88f98-cc00-4621-922f-bb4f6e08096c service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:00.199996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b88f98-cc00-4621-922f-bb4f6e08096c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:00.216644 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b88f98-cc00-4621-922f-bb4f6e08096c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:00.219409 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b88f98-cc00-4621-922f-bb4f6e08096c service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:00.238298 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1415/2838] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:39:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:39:18.399715 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423224d3-1b3c-49ab-9f49-120209985bba service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:18.474606 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423224d3-1b3c-49ab-9f49-120209985bba service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:18.479940 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:18.480817 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:18.481135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:18.481429 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] PATH_INFO: `/v3/users/fe55bda7d47447df90456d594cbece79` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:18.482699 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe55bda7d47447df90456d594cbece79)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:18.484620 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:18.740836 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe55bda7d47447df90456d594cbece79'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:18.753439 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe55bda7d47447df90456d594cbece79'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:18.754180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe55bda7d47447df90456d594cbece79'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:18.761600 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe55bda7d47447df90456d594cbece79'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:18.762257 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe55bda7d47447df90456d594cbece79'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:18.887711 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1424/2839] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:39:18 2022] DELETE /identity/v3/users/fe55bda7d47447df90456d594cbece79 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:39:19.191040 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b88f98-cc00-4621-922f-bb4f6e08096c service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:19.206192 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b88f98-cc00-4621-922f-bb4f6e08096c service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:19.277832 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:19.278619 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:19.278897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:19.279170 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] PATH_INFO: `/v3/projects/afd76447480d46cfb9524aec094e512c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:19.280405 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd76447480d46cfb9524aec094e512c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:19.282316 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:19.426342 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd76447480d46cfb9524aec094e512c', 'request_id': 'req-f0117fba-b94f-40d3-a2f3-54fdfc175d23'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:19.549945 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd76447480d46cfb9524aec094e512c', 'request_id': 'req-f0117fba-b94f-40d3-a2f3-54fdfc175d23'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:19.558113 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd76447480d46cfb9524aec094e512c', 'request_id': 'req-f0117fba-b94f-40d3-a2f3-54fdfc175d23'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:19.570237 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] The token cache is being invalidate because project afd76447480d46cfb9524aec094e512c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:39:19.573006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:19.573006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:19.573006 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1416/2840] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:39:19 2022] DELETE /identity/v3/projects/afd76447480d46cfb9524aec094e512c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:39:19.577244 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:19.579191 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:19.593793 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e04be-da2f-4b23-9d78-5896f3121fcb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:19.656004 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28286a-b514-443d-bc34-99c97de5531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:19.657103 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28286a-b514-443d-bc34-99c97de5531c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:19.657392 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28286a-b514-443d-bc34-99c97de5531c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:19.657674 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28286a-b514-443d-bc34-99c97de5531c admin admin] PATH_INFO: `/v3/users/1782bfb79eb943988db4e78e841cb036` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:19.658957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28286a-b514-443d-bc34-99c97de5531c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1782bfb79eb943988db4e78e841cb036)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:19.661022 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28286a-b514-443d-bc34-99c97de5531c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:19.923602 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7e28286a-b514-443d-bc34-99c97de5531c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1782bfb79eb943988db4e78e841cb036'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:19.937957 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7e28286a-b514-443d-bc34-99c97de5531c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1782bfb79eb943988db4e78e841cb036'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:19.938931 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7e28286a-b514-443d-bc34-99c97de5531c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1782bfb79eb943988db4e78e841cb036'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:19.948508 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7e28286a-b514-443d-bc34-99c97de5531c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1782bfb79eb943988db4e78e841cb036'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:19.949271 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7e28286a-b514-443d-bc34-99c97de5531c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1782bfb79eb943988db4e78e841cb036'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:20.235230 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1425/2841] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:39:19 2022] DELETE /identity/v3/users/1782bfb79eb943988db4e78e841cb036 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:39:20.591288 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:20.593184 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:20.608396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0117fba-b94f-40d3-a2f3-54fdfc175d23 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:20.673067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:20.673942 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:20.674405 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:20.674693 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] PATH_INFO: `/v3/projects/9e10c23fb46a4c4898a965e312cd44c6` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:20.676068 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e10c23fb46a4c4898a965e312cd44c6)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:20.678912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:20.895278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e10c23fb46a4c4898a965e312cd44c6', 'request_id': 'req-7a776e35-78a8-41a1-94f7-ed473dbd1b64'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:21.218535 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e10c23fb46a4c4898a965e312cd44c6', 'request_id': 'req-7a776e35-78a8-41a1-94f7-ed473dbd1b64'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:21.227140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e10c23fb46a4c4898a965e312cd44c6', 'request_id': 'req-7a776e35-78a8-41a1-94f7-ed473dbd1b64'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:21.239426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] The token cache is being invalidate because project 9e10c23fb46a4c4898a965e312cd44c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:39:21.239719 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:21.240565 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7a776e35-78a8-41a1-94f7-ed473dbd1b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:21.243256 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1417/2842] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:39:20 2022] DELETE /identity/v3/projects/9e10c23fb46a4c4898a965e312cd44c6 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:39:21.248516 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54d42b-3730-4b77-8f32-cedcc8fbe2ef None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:21.249131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54d42b-3730-4b77-8f32-cedcc8fbe2ef None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:21.249131 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54d42b-3730-4b77-8f32-cedcc8fbe2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:21.271082 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1a54d42b-3730-4b77-8f32-cedcc8fbe2ef None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:39:21.273764 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1a54d42b-3730-4b77-8f32-cedcc8fbe2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:21.339035 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1426/2843] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:39:21.346928 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9b75-6e86-4ae9-bb57-72f4fdcb4cfa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:21.347216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9b75-6e86-4ae9-bb57-72f4fdcb4cfa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:21.347498 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9b75-6e86-4ae9-bb57-72f4fdcb4cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:21.368142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-21ed9b75-6e86-4ae9-bb57-72f4fdcb4cfa None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:39:21.369581 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-21ed9b75-6e86-4ae9-bb57-72f4fdcb4cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:21.377758 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1418/2844] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:39:21.382919 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54d42b-3730-4b77-8f32-cedcc8fbe2ef None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:21.393193 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54d42b-3730-4b77-8f32-cedcc8fbe2ef None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:21.403995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17dec9-344f-4144-be08-12d63ef2aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:21.403995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17dec9-344f-4144-be08-12d63ef2aea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:21.403995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17dec9-344f-4144-be08-12d63ef2aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:21.403995 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17dec9-344f-4144-be08-12d63ef2aea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:21.404482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17dec9-344f-4144-be08-12d63ef2aea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:39:21.404482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17dec9-344f-4144-be08-12d63ef2aea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:21.404482 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17dec9-344f-4144-be08-12d63ef2aea3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:21.416514 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1427/2845] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 14:39:21.422586 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed9b75-6e86-4ae9-bb57-72f4fdcb4cfa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:21.432394 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed9b75-6e86-4ae9-bb57-72f4fdcb4cfa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:21.438600 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe07871-b706-4810-91a2-e24d9fbd41d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:21.439302 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe07871-b706-4810-91a2-e24d9fbd41d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:21.439584 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe07871-b706-4810-91a2-e24d9fbd41d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:21.439865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe07871-b706-4810-91a2-e24d9fbd41d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:21.440599 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe07871-b706-4810-91a2-e24d9fbd41d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:21.442631 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe07871-b706-4810-91a2-e24d9fbd41d8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:21.664283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1419/2846] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:39:21 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:39:21.669604 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17dec9-344f-4144-be08-12d63ef2aea3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:21.680387 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17dec9-344f-4144-be08-12d63ef2aea3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:21.742787 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d922a-4769-4d25-ac79-78935706e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:21.743465 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d922a-4769-4d25-ac79-78935706e6ae admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:21.743748 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d922a-4769-4d25-ac79-78935706e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:21.744025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d922a-4769-4d25-ac79-78935706e6ae admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:21.744780 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d922a-4769-4d25-ac79-78935706e6ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:21.746815 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d922a-4769-4d25-ac79-78935706e6ae admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:21.948704 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1428/2847] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:39:21 2022] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:39:21.953950 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe07871-b706-4810-91a2-e24d9fbd41d8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:21.965362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe07871-b706-4810-91a2-e24d9fbd41d8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:21.972747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74be190-dc08-4485-ae76-da079dae7bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:21.972747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74be190-dc08-4485-ae76-da079dae7bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:21.972747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74be190-dc08-4485-ae76-da079dae7bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:21.972747 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74be190-dc08-4485-ae76-da079dae7bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:21.973465 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74be190-dc08-4485-ae76-da079dae7bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:21.973855 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74be190-dc08-4485-ae76-da079dae7bb3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:21.985127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1420/2848] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:39:21.990175 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d922a-4769-4d25-ac79-78935706e6ae admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:22.000868 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d922a-4769-4d25-ac79-78935706e6ae admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:22.005790 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897ba12-cb9f-4347-adfe-18d6f5516961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:22.009159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ba12-cb9f-4347-adfe-18d6f5516961 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:22.009159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ba12-cb9f-4347-adfe-18d6f5516961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:22.009159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ba12-cb9f-4347-adfe-18d6f5516961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:22.009159 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897ba12-cb9f-4347-adfe-18d6f5516961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:22.010221 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897ba12-cb9f-4347-adfe-18d6f5516961 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:22.020939 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1429/2849] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:39:22.025900 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74be190-dc08-4485-ae76-da079dae7bb3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:22.036318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74be190-dc08-4485-ae76-da079dae7bb3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:22.042278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90f7a-4380-423e-b584-30e01fc7874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:22.043270 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90f7a-4380-423e-b584-30e01fc7874a admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:22.043643 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90f7a-4380-423e-b584-30e01fc7874a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:22.044028 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90f7a-4380-423e-b584-30e01fc7874a admin admin] PATH_INFO: `/v3/projects/a2311317c7cd4fc1acf8e2e4028efcc6/users/533a8fbd645948219883d7e6a0ecce7a/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:22.063355 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed90f7a-4380-423e-b584-30e01fc7874a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2311317c7cd4fc1acf8e2e4028efcc6, user_id=533a8fbd645948219883d7e6a0ecce7a, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:22.066912 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed90f7a-4380-423e-b584-30e01fc7874a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:22.218158 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1421/2850] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:39:22 2022] PUT /identity/v3/projects/a2311317c7cd4fc1acf8e2e4028efcc6/users/533a8fbd645948219883d7e6a0ecce7a/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:39:22.281978 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8fa63-1a07-4961-b26d-6ec15a47e2aa None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:22.282864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8fa63-1a07-4961-b26d-6ec15a47e2aa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:22.282864 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8fa63-1a07-4961-b26d-6ec15a47e2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:22.311102 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f1b8fa63-1a07-4961-b26d-6ec15a47e2aa None None] MFA Rules not processed for user `533a8fbd645948219883d7e6a0ecce7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:39:22.312390 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f1b8fa63-1a07-4961-b26d-6ec15a47e2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:22.376322 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1430/2851] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:39:22.388598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90f7a-4380-423e-b584-30e01fc7874a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:22.390347 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fed90f7a-4380-423e-b584-30e01fc7874a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:22.451296 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90f7a-4380-423e-b584-30e01fc7874a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:22.455318 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e0f4-4265-4f28-b96e-f1000440fdda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ca11a750dc4234b4512e6274ca01a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:22.455960 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e0f4-4265-4f28-b96e-f1000440fdda service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:22.456273 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e0f4-4265-4f28-b96e-f1000440fdda service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:22.456566 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e0f4-4265-4f28-b96e-f1000440fdda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:22.465996 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e0f4-4265-4f28-b96e-f1000440fdda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:22.467426 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e0f4-4265-4f28-b96e-f1000440fdda service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:22.478215 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1422/2852] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:39:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:39:27.666442 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8fa63-1a07-4961-b26d-6ec15a47e2aa None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:27.731165 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8fa63-1a07-4961-b26d-6ec15a47e2aa None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:27.735797 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:27.736673 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:27.736972 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:27.737268 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] PATH_INFO: `/v3/users/533a8fbd645948219883d7e6a0ecce7a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:27.738510 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] RBAC: Authorizing `identity:delete_user(user_id=533a8fbd645948219883d7e6a0ecce7a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:27.740663 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:28.116723 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533a8fbd645948219883d7e6a0ecce7a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:28.128891 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533a8fbd645948219883d7e6a0ecce7a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:28.129646 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533a8fbd645948219883d7e6a0ecce7a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:28.137554 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533a8fbd645948219883d7e6a0ecce7a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:28.138307 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533a8fbd645948219883d7e6a0ecce7a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:28.295047 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1431/2853] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:39:27 2022] DELETE /identity/v3/users/533a8fbd645948219883d7e6a0ecce7a => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:39:28.300562 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa896d52-338f-4b77-a457-efcfc8d5660d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:28.301172 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa896d52-338f-4b77-a457-efcfc8d5660d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:28.301388 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa896d52-338f-4b77-a457-efcfc8d5660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:28.321739 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-aa896d52-338f-4b77-a457-efcfc8d5660d None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:39:28.323041 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aa896d52-338f-4b77-a457-efcfc8d5660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:28.390020 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1423/2854] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:39:28.400215 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:28.401682 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:28.462774 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b96f-438b-40a2-9627-2833d370833e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:28.466478 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f890e3-492c-44c5-adbe-cb7215d8247b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:28.467135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f890e3-492c-44c5-adbe-cb7215d8247b service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:28.467422 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f890e3-492c-44c5-adbe-cb7215d8247b service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:28.467696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f890e3-492c-44c5-adbe-cb7215d8247b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:28.478104 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f890e3-492c-44c5-adbe-cb7215d8247b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:28.479548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f890e3-492c-44c5-adbe-cb7215d8247b service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:28.489459 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1432/2855] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:39:29.082306 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa896d52-338f-4b77-a457-efcfc8d5660d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:29.084231 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aa896d52-338f-4b77-a457-efcfc8d5660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:29.101200 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa896d52-338f-4b77-a457-efcfc8d5660d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:29.107410 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:29.109697 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:29.110019 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:29.110230 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] PATH_INFO: `/v3/projects/a2311317c7cd4fc1acf8e2e4028efcc6` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:29.111473 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2311317c7cd4fc1acf8e2e4028efcc6)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:29.113652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:29.350167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2311317c7cd4fc1acf8e2e4028efcc6', 'request_id': 'req-b1697420-7f1b-452e-8d34-e077bf63f45e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:29.485506 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2311317c7cd4fc1acf8e2e4028efcc6', 'request_id': 'req-b1697420-7f1b-452e-8d34-e077bf63f45e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:29.492730 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2311317c7cd4fc1acf8e2e4028efcc6', 'request_id': 'req-b1697420-7f1b-452e-8d34-e077bf63f45e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:29.503167 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] The token cache is being invalidate because project a2311317c7cd4fc1acf8e2e4028efcc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:39:29.503454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:29.504114 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1697420-7f1b-452e-8d34-e077bf63f45e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:39:29.506243 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1424/2856] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:39:29 2022] DELETE /identity/v3/projects/a2311317c7cd4fc1acf8e2e4028efcc6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 14:39:29.511638 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d82ba-547c-46dc-b32e-3ae50330a4c7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:29.512155 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d82ba-547c-46dc-b32e-3ae50330a4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:29.512327 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d82ba-547c-46dc-b32e-3ae50330a4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:29.532255 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f86d82ba-547c-46dc-b32e-3ae50330a4c7 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:39:29.567627 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f86d82ba-547c-46dc-b32e-3ae50330a4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:29.594622 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1433/2857] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:39:29.603275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff916e0-a893-4eaf-a0e3-883d2daac0cc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:29.603476 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff916e0-a893-4eaf-a0e3-883d2daac0cc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:29.603750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff916e0-a893-4eaf-a0e3-883d2daac0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:29.622985 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6ff916e0-a893-4eaf-a0e3-883d2daac0cc None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:39:29.624235 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6ff916e0-a893-4eaf-a0e3-883d2daac0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:29.633638 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1425/2858] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:39:29.637883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d82ba-547c-46dc-b32e-3ae50330a4c7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:29.648979 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d82ba-547c-46dc-b32e-3ae50330a4c7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:29.654080 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fa632-7ef4-457a-acfc-b27e3996cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:29.654745 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fa632-7ef4-457a-acfc-b27e3996cb3b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:29.655025 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fa632-7ef4-457a-acfc-b27e3996cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:29.655292 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fa632-7ef4-457a-acfc-b27e3996cb3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:29.656016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fa632-7ef4-457a-acfc-b27e3996cb3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 14:39:29.656321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fa632-7ef4-457a-acfc-b27e3996cb3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:29.657948 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fa632-7ef4-457a-acfc-b27e3996cb3b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:29.670970 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1434/2859] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Apr 12 14:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 14:39:29.675621 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff916e0-a893-4eaf-a0e3-883d2daac0cc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:29.685673 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff916e0-a893-4eaf-a0e3-883d2daac0cc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:29.690432 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024aeec-6118-46a9-843b-839e0a941574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:29.691085 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024aeec-6118-46a9-843b-839e0a941574 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:29.691395 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024aeec-6118-46a9-843b-839e0a941574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:29.691671 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024aeec-6118-46a9-843b-839e0a941574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:29.692373 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024aeec-6118-46a9-843b-839e0a941574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:29.695204 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024aeec-6118-46a9-843b-839e0a941574 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:30.048362 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1426/2860] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:39:29 2022] POST /identity/v3/projects => generated 373 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:39:30.052596 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fa632-7ef4-457a-acfc-b27e3996cb3b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:30.063051 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fa632-7ef4-457a-acfc-b27e3996cb3b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:30.128505 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e4799-a17e-4996-bd01-b149e95fd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:30.129607 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4799-a17e-4996-bd01-b149e95fd008 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:30.129951 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4799-a17e-4996-bd01-b149e95fd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:30.130287 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4799-a17e-4996-bd01-b149e95fd008 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:30.131291 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e4799-a17e-4996-bd01-b149e95fd008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:30.134503 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e4799-a17e-4996-bd01-b149e95fd008 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:30.294092 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1435/2861] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:39:30 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:39:30.298682 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024aeec-6118-46a9-843b-839e0a941574 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:30.309418 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024aeec-6118-46a9-843b-839e0a941574 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:30.314221 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e74d3f-fd2b-470d-a12b-1bfc242213b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:30.314897 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e74d3f-fd2b-470d-a12b-1bfc242213b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:30.315179 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e74d3f-fd2b-470d-a12b-1bfc242213b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:30.315458 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e74d3f-fd2b-470d-a12b-1bfc242213b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:30.316187 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e74d3f-fd2b-470d-a12b-1bfc242213b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:30.317903 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e74d3f-fd2b-470d-a12b-1bfc242213b4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:30.330140 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1427/2862] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 14:39:30.335297 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e4799-a17e-4996-bd01-b149e95fd008 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:30.353267 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e4799-a17e-4996-bd01-b149e95fd008 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:30.361317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a19ad-6863-4467-96e1-a479509a59fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:30.362368 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a19ad-6863-4467-96e1-a479509a59fe admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:30.362883 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a19ad-6863-4467-96e1-a479509a59fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:30.363395 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a19ad-6863-4467-96e1-a479509a59fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:30.364786 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a19ad-6863-4467-96e1-a479509a59fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:30.367696 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a19ad-6863-4467-96e1-a479509a59fe admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:30.386551 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1436/2863] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:39:30.390874 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e74d3f-fd2b-470d-a12b-1bfc242213b4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:30.401865 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e74d3f-fd2b-470d-a12b-1bfc242213b4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:30.406469 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92795323-ca32-4b76-a430-cb11be9032f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:30.407392 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92795323-ca32-4b76-a430-cb11be9032f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:30.407675 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92795323-ca32-4b76-a430-cb11be9032f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:30.407954 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92795323-ca32-4b76-a430-cb11be9032f3 admin admin] PATH_INFO: `/v3/projects/822526f20bd1480c8214dbd132e65356/users/56b64e44b70b4928bbffe5abb9830392/roles/a0c62419d02f426ea41c7faf22b2bf8a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:30.423378 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92795323-ca32-4b76-a430-cb11be9032f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822526f20bd1480c8214dbd132e65356, user_id=56b64e44b70b4928bbffe5abb9830392, role_id=a0c62419d02f426ea41c7faf22b2bf8a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:30.426066 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92795323-ca32-4b76-a430-cb11be9032f3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:30.555268 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1428/2864] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:39:30 2022] PUT /identity/v3/projects/822526f20bd1480c8214dbd132e65356/users/56b64e44b70b4928bbffe5abb9830392/roles/a0c62419d02f426ea41c7faf22b2bf8a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:39:30.560397 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bd011-8282-4be1-a0e3-fe51fb3d1f57 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:30.567436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bd011-8282-4be1-a0e3-fe51fb3d1f57 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:30.567436 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bd011-8282-4be1-a0e3-fe51fb3d1f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:30.579731 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1c9bd011-8282-4be1-a0e3-fe51fb3d1f57 None None] MFA Rules not processed for user `3d01d472ac8c4c32a41f169c9057727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:39:30.581012 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1c9bd011-8282-4be1-a0e3-fe51fb3d1f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:30.651529 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1437/2865] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 14:39:30.661283 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92795323-ca32-4b76-a430-cb11be9032f3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:30.663752 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-92795323-ca32-4b76-a430-cb11be9032f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:30.723152 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92795323-ca32-4b76-a430-cb11be9032f3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:30.727300 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b28dd1-9078-45d8-a4da-fdb2db522cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:30.727987 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b28dd1-9078-45d8-a4da-fdb2db522cbc service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:30.728275 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b28dd1-9078-45d8-a4da-fdb2db522cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:30.728555 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b28dd1-9078-45d8-a4da-fdb2db522cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:30.738783 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b28dd1-9078-45d8-a4da-fdb2db522cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:30.740520 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b28dd1-9078-45d8-a4da-fdb2db522cbc service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:30.751402 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1429/2866] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:39:37.857355 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a855c-c359-4b90-ab0b-828a8e465d5c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:37.858544 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a855c-c359-4b90-ab0b-828a8e465d5c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:37.859258 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a855c-c359-4b90-ab0b-828a8e465d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:37.891366 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1b0a855c-c359-4b90-ab0b-828a8e465d5c None None] MFA Rules not processed for user `56b64e44b70b4928bbffe5abb9830392`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:39:37.892598 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1b0a855c-c359-4b90-ab0b-828a8e465d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:37.961477 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1438/2867] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:39:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:39:37.965976 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b28dd1-9078-45d8-a4da-fdb2db522cbc service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:37.977069 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b28dd1-9078-45d8-a4da-fdb2db522cbc service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:37.981921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b1c2c-f751-4881-af00-57a4cde19f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:37.982627 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b1c2c-f751-4881-af00-57a4cde19f3e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:37.983127 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b1c2c-f751-4881-af00-57a4cde19f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:37.983402 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b1c2c-f751-4881-af00-57a4cde19f3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:37.984105 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b1c2c-f751-4881-af00-57a4cde19f3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:37.986038 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b1c2c-f751-4881-af00-57a4cde19f3e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:38.151278 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1430/2868] 10.222.0.61 () {60 vars in 1152 bytes} [Tue Apr 12 14:39:37 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:39:38.157071 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a855c-c359-4b90-ab0b-828a8e465d5c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:38.167246 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a855c-c359-4b90-ab0b-828a8e465d5c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:38.224832 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95238b7b-33ac-4bc8-b7bf-0356bf98b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:38.225541 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95238b7b-33ac-4bc8-b7bf-0356bf98b494 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:38.225825 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95238b7b-33ac-4bc8-b7bf-0356bf98b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:38.226101 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95238b7b-33ac-4bc8-b7bf-0356bf98b494 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:38.226816 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95238b7b-33ac-4bc8-b7bf-0356bf98b494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:38.228743 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95238b7b-33ac-4bc8-b7bf-0356bf98b494 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:38.349405 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1439/2869] 10.222.0.61 () {60 vars in 1143 bytes} [Tue Apr 12 14:39:38 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 14:39:38.353641 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b1c2c-f751-4881-af00-57a4cde19f3e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:38.363811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b1c2c-f751-4881-af00-57a4cde19f3e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:38.368807 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469c855-5d13-41d7-b792-814151fa5075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:38.369463 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469c855-5d13-41d7-b792-814151fa5075 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:38.369744 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469c855-5d13-41d7-b792-814151fa5075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:38.370018 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469c855-5d13-41d7-b792-814151fa5075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:38.370740 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469c855-5d13-41d7-b792-814151fa5075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:38.372325 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469c855-5d13-41d7-b792-814151fa5075 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:38.384694 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1431/2870] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:39:38.389224 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95238b7b-33ac-4bc8-b7bf-0356bf98b494 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:38.400144 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95238b7b-33ac-4bc8-b7bf-0356bf98b494 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:38.405180 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb183-76f2-4257-953f-a414e9a9d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:38.406406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb183-76f2-4257-953f-a414e9a9d4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:38.406406 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb183-76f2-4257-953f-a414e9a9d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:38.406641 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb183-76f2-4257-953f-a414e9a9d4a9 admin admin] PATH_INFO: `/v3/projects/8aaa49a63483422d860d653a054b920c/users/878974a59165495bb41d22d2f4ff4f48/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:38.422238 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddb183-76f2-4257-953f-a414e9a9d4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aaa49a63483422d860d653a054b920c, user_id=878974a59165495bb41d22d2f4ff4f48, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:38.424876 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddb183-76f2-4257-953f-a414e9a9d4a9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:38.498221 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1440/2871] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:39:38 2022] PUT /identity/v3/projects/8aaa49a63483422d860d653a054b920c/users/878974a59165495bb41d22d2f4ff4f48/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:39:38.503199 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469c855-5d13-41d7-b792-814151fa5075 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:38.515896 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469c855-5d13-41d7-b792-814151fa5075 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:38.580380 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfd586-43c2-4472-99ce-9f6c1a0ac87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:38.581089 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd586-43c2-4472-99ce-9f6c1a0ac87e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:38.581377 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd586-43c2-4472-99ce-9f6c1a0ac87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:38.581654 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd586-43c2-4472-99ce-9f6c1a0ac87e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:38.582386 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfd586-43c2-4472-99ce-9f6c1a0ac87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:38.584036 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfd586-43c2-4472-99ce-9f6c1a0ac87e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:38.594709 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1432/2872] 10.222.0.61 () {58 vars in 1121 bytes} [Tue Apr 12 14:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 14:39:38.598959 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb183-76f2-4257-953f-a414e9a9d4a9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:38.609524 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb183-76f2-4257-953f-a414e9a9d4a9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:38.614147 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ae5c9-bd32-4b51-acb6-4444d131a192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:38.615562 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ae5c9-bd32-4b51-acb6-4444d131a192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:38.615902 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ae5c9-bd32-4b51-acb6-4444d131a192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:38.616206 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ae5c9-bd32-4b51-acb6-4444d131a192 admin admin] PATH_INFO: `/v3/projects/8aaa49a63483422d860d653a054b920c/users/878974a59165495bb41d22d2f4ff4f48/roles/fcc1fe96070d4683b1979cb74c1e7184` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:38.618317 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ae5c9-bd32-4b51-acb6-4444d131a192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aaa49a63483422d860d653a054b920c, user_id=878974a59165495bb41d22d2f4ff4f48, role_id=fcc1fe96070d4683b1979cb74c1e7184)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:38.620956 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ae5c9-bd32-4b51-acb6-4444d131a192 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:38.632212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1441/2873] 10.222.0.61 () {60 vars in 1482 bytes} [Tue Apr 12 14:39:38 2022] PUT /identity/v3/projects/8aaa49a63483422d860d653a054b920c/users/878974a59165495bb41d22d2f4ff4f48/roles/fcc1fe96070d4683b1979cb74c1e7184 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:39:45.691923 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7432-748c-4d48-b986-b9e548d0cb86 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:45.693272 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7432-748c-4d48-b986-b9e548d0cb86 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:45.693272 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7432-748c-4d48-b986-b9e548d0cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:45.724051 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ea7d7432-748c-4d48-b986-b9e548d0cb86 None None] MFA Rules not processed for user `878974a59165495bb41d22d2f4ff4f48`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:39:45.725385 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ea7d7432-748c-4d48-b986-b9e548d0cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:45.800460 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1433/2874] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:39:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:39:45.813338 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ae5c9-bd32-4b51-acb6-4444d131a192 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:39:45.819172 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-132ae5c9-bd32-4b51-acb6-4444d131a192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:45.922592 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ae5c9-bd32-4b51-acb6-4444d131a192 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:39:45.929152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7747f-c5b9-484d-84ef-a7dca98efbfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:39:45.929839 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7747f-c5b9-484d-84ef-a7dca98efbfa service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:45.935768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7747f-c5b9-484d-84ef-a7dca98efbfa service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:45.935768 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7747f-c5b9-484d-84ef-a7dca98efbfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:45.994671 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7747f-c5b9-484d-84ef-a7dca98efbfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:39:45.996286 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7747f-c5b9-484d-84ef-a7dca98efbfa service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:39:46.006433 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1442/2875] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:39:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:39:50.360845 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f3869-e264-4ea4-9bc5-ba9856e2df00 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:39:50.361550 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f3869-e264-4ea4-9bc5-ba9856e2df00 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:39:50.361837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f3869-e264-4ea4-9bc5-ba9856e2df00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:39:50.380915 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bb0f3869-e264-4ea4-9bc5-ba9856e2df00 None None] MFA Rules not processed for user `56b64e44b70b4928bbffe5abb9830392`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:39:50.382216 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bb0f3869-e264-4ea4-9bc5-ba9856e2df00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:39:50.389021 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1434/2876] 10.222.0.61 () {58 vars in 957 bytes} [Tue Apr 12 14:39:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:40:06.400843 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7747f-c5b9-484d-84ef-a7dca98efbfa service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:40:06.405077 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a0b7747f-c5b9-484d-84ef-a7dca98efbfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:40:06.461823 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7747f-c5b9-484d-84ef-a7dca98efbfa service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:40:06.465467 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45d64-7950-4770-b46b-33c3e0d2c880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:40:06.466207 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45d64-7950-4770-b46b-33c3e0d2c880 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:40:06.466488 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45d64-7950-4770-b46b-33c3e0d2c880 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:40:06.466759 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45d64-7950-4770-b46b-33c3e0d2c880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:40:06.468518 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5ae45d64-7950-4770-b46b-33c3e0d2c880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:40:06.479032 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae45d64-7950-4770-b46b-33c3e0d2c880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:40:06.480515 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae45d64-7950-4770-b46b-33c3e0d2c880 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:40:06.489352 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1443/2877] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:40:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:40:33.843659 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f3869-e264-4ea4-9bc5-ba9856e2df00 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:40:33.857728 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f3869-e264-4ea4-9bc5-ba9856e2df00 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:40:33.861366 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a97dd-a1ab-4a13-83ee-dc21ff1fb97f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:40:33.862614 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a97dd-a1ab-4a13-83ee-dc21ff1fb97f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:40:33.862890 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a97dd-a1ab-4a13-83ee-dc21ff1fb97f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:40:33.863160 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a97dd-a1ab-4a13-83ee-dc21ff1fb97f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:40:33.872628 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a97dd-a1ab-4a13-83ee-dc21ff1fb97f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:40:33.884811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a97dd-a1ab-4a13-83ee-dc21ff1fb97f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:40:33.884811 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1435/2878] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:40:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:41:47.435876 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45d64-7950-4770-b46b-33c3e0d2c880 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:41:47.445227 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45d64-7950-4770-b46b-33c3e0d2c880 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:41:47.449383 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7dda0-c84a-4da0-bc16-ced984ae62e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:41:47.449985 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7dda0-c84a-4da0-bc16-ced984ae62e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:41:47.449985 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7dda0-c84a-4da0-bc16-ced984ae62e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:41:47.450227 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7dda0-c84a-4da0-bc16-ced984ae62e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:41:47.452594 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bca7dda0-c84a-4da0-bc16-ced984ae62e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:41:47.463791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7dda0-c84a-4da0-bc16-ced984ae62e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:41:47.465353 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7dda0-c84a-4da0-bc16-ced984ae62e5 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:41:47.473915 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1444/2879] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:41:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:42:25.737372 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a97dd-a1ab-4a13-83ee-dc21ff1fb97f service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:42:25.746420 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a97dd-a1ab-4a13-83ee-dc21ff1fb97f service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:42:25.750936 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50db08-9e6a-4ca2-a9a9-f7b0858d2a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:42:25.751578 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50db08-9e6a-4ca2-a9a9-f7b0858d2a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:42:25.751885 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50db08-9e6a-4ca2-a9a9-f7b0858d2a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:42:25.752165 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50db08-9e6a-4ca2-a9a9-f7b0858d2a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:42:25.754027 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6c50db08-9e6a-4ca2-a9a9-f7b0858d2a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:42:25.768291 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50db08-9e6a-4ca2-a9a9-f7b0858d2a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:42:25.769733 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50db08-9e6a-4ca2-a9a9-f7b0858d2a53 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:42:25.780978 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1436/2880] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:42:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:42:26.966400 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7dda0-c84a-4da0-bc16-ced984ae62e5 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:42:26.975341 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7dda0-c84a-4da0-bc16-ced984ae62e5 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:42:26.979281 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f65a67-7612-4c59-9112-38704ed1d880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:42:26.979916 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65a67-7612-4c59-9112-38704ed1d880 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:42:26.980199 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65a67-7612-4c59-9112-38704ed1d880 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:42:26.980494 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65a67-7612-4c59-9112-38704ed1d880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:42:26.982820 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-55f65a67-7612-4c59-9112-38704ed1d880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:42:27.002138 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f65a67-7612-4c59-9112-38704ed1d880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:42:27.003599 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f65a67-7612-4c59-9112-38704ed1d880 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:42:27.016137 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1445/2881] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:42:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:42:40.494193 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2312d1-8f62-4167-9286-322abfbc3246 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:42:40.494767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2312d1-8f62-4167-9286-322abfbc3246 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:42:40.494767 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2312d1-8f62-4167-9286-322abfbc3246 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:42:40.496142 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1437/2882] 10.222.0.61 () {54 vars in 921 bytes} [Tue Apr 12 14:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:42:40.502776 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae9818-9abe-46cd-8e40-4eb90507a4e4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:42:40.505635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae9818-9abe-46cd-8e40-4eb90507a4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:42:40.505635 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae9818-9abe-46cd-8e40-4eb90507a4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:42:40.549490 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-35ae9818-9abe-46cd-8e40-4eb90507a4e4 None None] MFA Rules not processed for user `fa7ee0856f4644c994c3ccbd400b6fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:42:40.550692 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-35ae9818-9abe-46cd-8e40-4eb90507a4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:42:40.557177 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1446/2883] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Apr 12 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:42:40.569862 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2312d1-8f62-4167-9286-322abfbc3246 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:42:40.580836 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2312d1-8f62-4167-9286-322abfbc3246 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:42:40.584611 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9cc53-daee-49c0-ab5d-29980065a886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:42:40.585286 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9cc53-daee-49c0-ab5d-29980065a886 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:42:40.585564 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9cc53-daee-49c0-ab5d-29980065a886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:42:40.585841 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9cc53-daee-49c0-ab5d-29980065a886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:42:40.592775 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9cc53-daee-49c0-ab5d-29980065a886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:42:40.594249 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9cc53-daee-49c0-ab5d-29980065a886 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:42:40.601980 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1438/2884] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:42:40.684241 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc499b9-9214-4d4e-abc0-e7d7b6902fa4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:42:40.684521 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc499b9-9214-4d4e-abc0-e7d7b6902fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:42:40.685486 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc499b9-9214-4d4e-abc0-e7d7b6902fa4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:42:40.687152 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1447/2885] 10.222.0.61 () {54 vars in 921 bytes} [Tue Apr 12 14:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 14:42:40.693598 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428120-7223-4090-97ba-ebc959cf87db None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:42:40.693893 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428120-7223-4090-97ba-ebc959cf87db None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:42:40.694174 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428120-7223-4090-97ba-ebc959cf87db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:42:40.730034 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b7428120-7223-4090-97ba-ebc959cf87db None None] MFA Rules not processed for user `b9933c6dc8f74cd59f6a1f8c11abf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 14:42:40.731235 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b7428120-7223-4090-97ba-ebc959cf87db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:42:40.741321 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1439/2886] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Apr 12 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 14:42:40.753212 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc499b9-9214-4d4e-abc0-e7d7b6902fa4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:42:40.764356 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc499b9-9214-4d4e-abc0-e7d7b6902fa4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:42:40.768121 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e937-1080-4a5a-9d7b-b33659ddc946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ee0856f4644c994c3ccbd400b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:42:40.768784 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e937-1080-4a5a-9d7b-b33659ddc946 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:42:40.769110 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e937-1080-4a5a-9d7b-b33659ddc946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:42:40.769411 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e937-1080-4a5a-9d7b-b33659ddc946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:42:40.779900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5e937-1080-4a5a-9d7b-b33659ddc946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:42:40.781363 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5e937-1080-4a5a-9d7b-b33659ddc946 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:42:40.791827 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1448/2887] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:42:40.858344 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7428120-7223-4090-97ba-ebc959cf87db None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:42:40.859750 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b7428120-7223-4090-97ba-ebc959cf87db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:42:40.925645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7428120-7223-4090-97ba-ebc959cf87db None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:42:40.930720 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a93ee1-3bc2-48d1-9ceb-e03947b54209 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7095f3ab8545c589d4d28a846ba1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:42:40.931361 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a93ee1-3bc2-48d1-9ceb-e03947b54209 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:42:40.931645 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a93ee1-3bc2-48d1-9ceb-e03947b54209 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:42:40.931921 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a93ee1-3bc2-48d1-9ceb-e03947b54209 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:42:40.933716 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d2a93ee1-3bc2-48d1-9ceb-e03947b54209 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:42:40.945353 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a93ee1-3bc2-48d1-9ceb-e03947b54209 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:42:40.946911 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a93ee1-3bc2-48d1-9ceb-e03947b54209 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:42:40.957115 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1440/2888] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:42:42.009738 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e937-1080-4a5a-9d7b-b33659ddc946 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:42:42.020761 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e937-1080-4a5a-9d7b-b33659ddc946 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:42:42.026468 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119859d2-726d-45a7-9edc-8c2259914b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:42:42.027124 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119859d2-726d-45a7-9edc-8c2259914b91 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:42:42.030869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119859d2-726d-45a7-9edc-8c2259914b91 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:42:42.030869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119859d2-726d-45a7-9edc-8c2259914b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:42:42.030869 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-119859d2-726d-45a7-9edc-8c2259914b91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:42:42.042314 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119859d2-726d-45a7-9edc-8c2259914b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:42:42.043872 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119859d2-726d-45a7-9edc-8c2259914b91 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:42:42.056548 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1449/2889] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:42:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:43:54.705425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a93ee1-3bc2-48d1-9ceb-e03947b54209 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:43:54.706819 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d2a93ee1-3bc2-48d1-9ceb-e03947b54209 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:43:54.720176 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a93ee1-3bc2-48d1-9ceb-e03947b54209 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:43:54.725213 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae369d-aa22-4656-92eb-8977cef7884c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7095f3ab8545c589d4d28a846ba1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:43:54.725850 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae369d-aa22-4656-92eb-8977cef7884c service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:43:54.726134 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae369d-aa22-4656-92eb-8977cef7884c service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:43:54.726411 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae369d-aa22-4656-92eb-8977cef7884c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:43:54.728138 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-22ae369d-aa22-4656-92eb-8977cef7884c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:43:54.740421 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae369d-aa22-4656-92eb-8977cef7884c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:43:54.742067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae369d-aa22-4656-92eb-8977cef7884c service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:43:54.751998 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1441/2890] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:43:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:44:07.228361 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119859d2-726d-45a7-9edc-8c2259914b91 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:44:07.241016 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119859d2-726d-45a7-9edc-8c2259914b91 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:44:07.249153 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b2a7b-ec25-4251-a9c5-3a62e5b6f348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9933c6dc8f74cd59f6a1f8c11abf652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:44:07.249812 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b2a7b-ec25-4251-a9c5-3a62e5b6f348 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:44:07.250093 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b2a7b-ec25-4251-a9c5-3a62e5b6f348 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:44:07.250365 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b2a7b-ec25-4251-a9c5-3a62e5b6f348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:44:07.252202 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-df7b2a7b-ec25-4251-a9c5-3a62e5b6f348 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:44:07.264791 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b2a7b-ec25-4251-a9c5-3a62e5b6f348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:44:07.266402 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b2a7b-ec25-4251-a9c5-3a62e5b6f348 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:44:07.277788 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1450/2891] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:44:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 14:44:20.380014 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae369d-aa22-4656-92eb-8977cef7884c service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:44:20.442952 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae369d-aa22-4656-92eb-8977cef7884c service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:44:20.447620 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:44:20.448487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:44:20.448765 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:44:20.449067 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] PATH_INFO: `/v3/users/56b64e44b70b4928bbffe5abb9830392` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:44:20.450253 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b64e44b70b4928bbffe5abb9830392)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:44:20.452396 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:44:20.707454 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b64e44b70b4928bbffe5abb9830392'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:20.719824 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b64e44b70b4928bbffe5abb9830392'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:20.824487 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b64e44b70b4928bbffe5abb9830392'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:20.832930 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b64e44b70b4928bbffe5abb9830392'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:20.833603 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b64e44b70b4928bbffe5abb9830392'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:20.839320 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1442/2892] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:44:20 2022] DELETE /identity/v3/users/56b64e44b70b4928bbffe5abb9830392 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:44:21.089008 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b2a7b-ec25-4251-a9c5-3a62e5b6f348 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:44:21.100927 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b2a7b-ec25-4251-a9c5-3a62e5b6f348 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:44:21.158900 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:44:21.159755 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:44:21.160034 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:44:21.160309 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] PATH_INFO: `/v3/projects/822526f20bd1480c8214dbd132e65356` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:44:21.161523 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=822526f20bd1480c8214dbd132e65356)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:44:21.163452 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:44:21.321321 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822526f20bd1480c8214dbd132e65356', 'request_id': 'req-a3ba4bdd-56be-4372-9150-2155af8082ff'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:21.396069 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822526f20bd1480c8214dbd132e65356', 'request_id': 'req-a3ba4bdd-56be-4372-9150-2155af8082ff'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:21.402520 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822526f20bd1480c8214dbd132e65356', 'request_id': 'req-a3ba4bdd-56be-4372-9150-2155af8082ff'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:21.413702 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] The token cache is being invalidate because project 822526f20bd1480c8214dbd132e65356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:44:21.413984 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:21.414655 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:21.416198 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1451/2893] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:44:21 2022] DELETE /identity/v3/projects/822526f20bd1480c8214dbd132e65356 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:44:21.422699 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:44:21.422699 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:44:21.435164 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bd591-a1bd-4291-809b-a46356499e6b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:44:21.492084 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:44:21.493002 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:44:21.493285 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:44:21.493562 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] PATH_INFO: `/v3/users/878974a59165495bb41d22d2f4ff4f48` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:44:21.494776 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878974a59165495bb41d22d2f4ff4f48)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:44:21.496681 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:44:21.714224 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878974a59165495bb41d22d2f4ff4f48'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:21.726076 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878974a59165495bb41d22d2f4ff4f48'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:21.825058 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878974a59165495bb41d22d2f4ff4f48'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:21.834033 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878974a59165495bb41d22d2f4ff4f48'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:21.834652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878974a59165495bb41d22d2f4ff4f48'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:21.840537 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1443/2894] 10.222.0.61 () {58 vars in 1223 bytes} [Tue Apr 12 14:44:21 2022] DELETE /identity/v3/users/878974a59165495bb41d22d2f4ff4f48 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:44:22.147135 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:44:22.148574 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:44:22.173223 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba4bdd-56be-4372-9150-2155af8082ff admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:44:22.219301 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d01d472ac8c4c32a41f169c9057727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882ed88f2204017b2d59722788747c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:44:22.220272 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:44:22.220597 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:44:22.220830 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] PATH_INFO: `/v3/projects/8aaa49a63483422d860d653a054b920c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:44:22.222067 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aaa49a63483422d860d653a054b920c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:44:22.223966 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:44:22.360990 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aaa49a63483422d860d653a054b920c', 'request_id': 'req-f8d26009-55ff-451f-b2c0-1b62f01a8172'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:22.447601 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aaa49a63483422d860d653a054b920c', 'request_id': 'req-f8d26009-55ff-451f-b2c0-1b62f01a8172'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:22.455057 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aaa49a63483422d860d653a054b920c', 'request_id': 'req-f8d26009-55ff-451f-b2c0-1b62f01a8172'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:22.465414 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] The token cache is being invalidate because project 8aaa49a63483422d860d653a054b920c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 14:44:22.465698 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:22.467254 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f8d26009-55ff-451f-b2c0-1b62f01a8172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 14:44:22.467911 dv-cinder-837522-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1452/2895] 10.222.0.61 () {58 vars in 1232 bytes} [Tue Apr 12 14:44:22 2022] DELETE /identity/v3/projects/8aaa49a63483422d860d653a054b920c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 14:49:00.687437 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 14:49:00.688837 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:49:00.825741 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1ba43-5ea6-4032-9c2b-9bcd3d86b865 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 14:49:00.882802 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c01e08-8750-4f52-ab72-7a1416c3a988 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7095f3ab8545c589d4d28a846ba1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e8cdd6573ea4a0a86a689e9a7d254c4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 14:49:00.884029 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c01e08-8750-4f52-ab72-7a1416c3a988 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 14:49:00.884313 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c01e08-8750-4f52-ab72-7a1416c3a988 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 14:49:00.884590 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c01e08-8750-4f52-ab72-7a1416c3a988 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 14:49:00.886444 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-53c01e08-8750-4f52-ab72-7a1416c3a988 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 14:49:00.898425 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c01e08-8750-4f52-ab72-7a1416c3a988 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 14:49:00.899652 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c01e08-8750-4f52-ab72-7a1416c3a988 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 14:49:00.910552 dv-cinder-837522-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1444/2896] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Apr 12 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)